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CHAPTER  1 


INTRODUCTION  TO  QUEUEING  THEORY 

1.1  Introdaction 

A  queue  is  s  vsitiag  line  of  customers  at  s  service  center. 
Depending  on  the  service  center,  service  is  provided  by  either  s  single 
server  or  aultiple  servers  which  operate  in  parallel.  Figure  1.1 
depicts  a  typical  service  center.  Custoaers  arrive  at  the  service 
center*  wait  in  line  for  a  server  to  beeoae  free,  receive  service,  and 
depart.  For  a  service  center  to  be  stable,  the  aean  deaand  for  aervice 
cannot  be  greater  than  the  eapaeity  that  can  be  provided. 

However,  spurious  arrivals  and  statistical  fluctuations  in  service 
requireaents  can  teaporally  cause  deaand  to  exceed  the  capacity.  Then 
this  occurs,  a  queue  of  waiting  oustoaers  will  fora. 


ARRIVING 

CUSTOMERS 


r~ 

l 

1 

1 

1 

1 

1 

SERVER! 

fo 

- 1 

i 

5  | 

1 

1 

1 

*  ,  1  i  |  i  | 

r  -/ 

1  ! 

i-  *  - 

.  •  1  1  1  1  1 

•  QUEUE 

1 

1 

l 

■  S 

.  •  •  • 

ipj 

?  ® 

1 

1 

1 

| 

L 

SERVICE  CENTER 

_ 1 

DEPARTING 

CUSTOMERS 


Figure  1.1  A  Typical  Service  Center 


The  psrpoi*  of  a  qneneing  aodel  is  to  prodiet  the  perforaance  of  o 
physioal  systea  in  which  there  is  contention  for  reeonrees.  The 
resonreee  ere  represented  in  the  aodel  by  the  serwers.  Any  reelistie 
qneneing  aodel  anst  incorporate  ststistieel  parsaeters.  For  exaaple,  it 
is  nsnally  not  possible  to  predict  with  oertainty  when  the  next 
onstoaer  will  arrive  or  what  his  exact  service  tiae  will  be.  However, 
it  is  often  possible  to  assign  probabilities  to  possible  valnes  or 
continnons  intervals  of  possible  values.  That  is,  these  paraaeters  are 
nsnally  randoa  variables  that  can  best  be  characterised  by  probability 
distribution  functions.  Since  the  paraaeters  that  describe  a  qneneing 
aodel  are  randoa  variables,  the  perforaanoe  paraaeters  are  also  randoa 
variablea.  Thus,  qneneing  aodela  are  used  to  answer  probabilistic 
questions  such  as:  what  is  the  probability  that  a  service  center  will 
have  k  cnstoaers  at  tiae  t,  or  what  is  the  probability  that  the  waiting 
tine  of  an  arbitrary  onstoaer  is  less  than  sons  fixed  valne  x? 

Probably  the  best  way  to  illustrate  a  qneneing  aodel  and 
deaonstrate  its  purpose  is  by  exaaple.  Figure  1.2  is  a  aodel  of  a  saall 
batch  coapnter  systea.  The  labels  on  the  arcs  are  routing 
probabilities.  It  is  assnaed  that  the  critical  reeonrees  are  the 
central  processing  unit  (CPU),  a  hard  disk,  end  a  floppy  disk.  These 
are  represented  in  the  aodel  by  single  server  service  centers.  A 
onstoaer  or  job  arrives  froa  outside  the  systea  and  waits  in  a  qnene  at 
the  CPU  for  service.  After  receiving  soae  service  at  the  CPU,  the  job 
requires  a  hard  or  floppy  disk  operation  before  it  can  proceed  (the 
probability  that  it  needs  the  hard  disk  is  0.8,  and  the  probability  it 


SOURCE 


Figure  1.2  Exaaple  of  an  Open  Queueing  Network  Model. 


needs  the  floppy  disk  is  0.2).  Since  these  operations  are  usually  slow 
coapared  to  those  at  the  CPU,  the  CPU  releases  the  Job  and  starts  to 
work  on  another  one.  The  released  job  proceeds  to  the  qnene  at  the 
appropriate  disk  and  waits  for  servioe.  After  receiving  disk  service 
the  job  either  exits  the  systea  or  return  to  the  qnene  at  the  CPU  for 
aore  service  (the  probability  it  exits  the  systea  is  0.1,  and  the 
probability  it  returns  to  the  CPU  is  0.9). 

In  order  to  analyse  such  a  nodal  the  arrival  process,  the  routing 
probabilities,  the  service  denand,  and  the  order  in  which  jobs  are 
served  anst  be  described.  Soae  of  the  perforaance  paraaeters  that  can 
be  obtained  froa  the  nodal  are  :  the  seas  waiting  tiae,  the  aean 


le,  the  aean  throughput,  the  aean  nuaber  of  jobs  at  each  service 


center,  and  the  utilisation  at  each  service  center. 
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The  aodel  is  Figare  1.2  is  clsssifisd  as  aa  opsa  qaeaeiag  network 
aodel.  The  word  network  refers  to  tke  faot  that  there  is  aore  thaa  oae 


service  eeater  ia  the  aodel.  The  word  opea  is  ia  refereace  to  the 
arrival  process.  Ia  aa  opea  qaeaeiag  aodel  castoaers  arrive  froa 
oatside  of  the  systea  aad  leave  the  systea  oaoe  their  servioe  deaaad 
hae  beea  act. 

Figare  1.3  depicts  a  dosed  qaeaeiag  network  aodel  of  an 
interactive  coapater  systea.  The  stractare  of  the  aodel  is  the  saae  as 

i 

i 

i 


Figare  1.3  Ezaaple  of  Closed  Qaeaeiag  Network  Model. 

the  oae  in  Figare  1.2  with  the  exception  of  how  castoaers  enter  the 
systea.  Ia  this  aodel  there  are  a  finite  naaber  of  teraiaals,  I,  and  it 
is  assaaed  that  there  is  always  oae  oastoaer  at  each  terainal.  That, 
once  a  cnstoaer's  service  deaaad  is  net.  he  is  iaaediately  replaced  by 
a  new  oastoaer.  Clearly,  the  systea  is  eqaivaleat  to  one  in  which 

4 


custoaers  can  neither  aster  or  leave  the  systea,  and  heaoe  the  ease 
closed.  In  addition,  the  systea  ia  aelf  regulating  in  that  is 
iapoasible  for  the  seen  service  deaand  to  ezoeed  the  capacity.  If  a 
new  cnstoaer  tries  to  enter  the  systea  when  it  contains  K  cnstoaera,  he 
is  siaple  turned  away.  Although  the  structure  of  this  aodel  ia  aiailar 
to  the  one  is  Figure  1.2  the  service  deaand  and  routing  probabilities 
are  nasally  qnite  different.  Is  addition,  the  paraaeter  that  one 
usually  varies  in  an  open  network  is  the  arrival  rate,  whereas  in  a 
closed  network  it  is  K. 

The  focus  of  this  text  ia  queueing  network  theory,  however  before 
one  can  analyse  a  network  of  serviee  centers,  he  aust  first  learn  how 
to  analyse  single  service  centers.  The  rest  of  the  chapter  and  several 
aore  are  devoted  to  this. 

1.2  smdy-smt 

Since  a  queueing  aodel  of  a  physical  systea  is  a  probability 
aodel,  the  nuaber  of  cnstoaera  is  a  service  center  at  tiae  t  is  a 
discrete  randoa  variable.  Let  N(t)  denote  this  randoa  variable  and  let 
Pfc(t)  «  P[N(t)-k],  That  is,  P^(t)  is  the  probability  of  finding  k 
cnstoaera  in  the  systea  at  tiae  t.  P^(t)  depends  not  only  on  the  value 
of  t,  but  also  on  the  nuaber  of  cnstoaera  in  the  center  at  t»0.  For 
saall  values  of  t,  the  nuaber  of  custoaers  in  the  service  center  will 
be  largely  influenced  by  the  nuaber  of  initial  custoaers.  However,  as  t 
becoaes  larger  the  influence  will  becoae  lees,  and  after  a  sufficient 
period  of  tiae  the  nuaber  of  custoaers  in  the  service  center  will 


becoae  effectively  independent  of  the  initial  nuaber  of  custoaers.  The 


probability  diatribatioa  of  tba  iatararrival  tiaaa  (that  ia  tba  tiaaa 
batvaaa  aaeeaaaiva  arrivala  of  eaatoaara  at  tba  aarviea  caatar).  Tba 
aaaaaptioaa  aaad  ia  aoat  of  qaaaaiag  tbaory  ara  that  tbaaa  iatararrival 
tiaaa  ara  both  iadapaadaat  aad  idaatieally  diatribatad  raadoa 
▼ariablaa.  Haaoa,  they  all  have  tba  aaaa  probability  diatribatioa 
faaetioa  (PDF)  wbieb  daaeribaa  tba  arrival  proeaaa.  Tba  arrival  proeaaa 
ia  daaotad  by  A(t)  aad  ia  by  dafiaitioa: 

A(t)  “  P(tiaa  batvaaa  arrivala  i  t].  (1.2) 
Ia  ordar  to  aatiafy  tba  aaaaaptioaa  of  iadapaadaat  aad  idaatieally 
diatribatad  raadoa  variablea,  it  aay  ba  aaoaaaary  to  partitioa  tba 
arrival  atraaa  iato  elaaaaa  of  eaatoaara  aad  dafiaa  a  PDP  for  aacb 
olaaa. 

Tba  aaeoad  atatiatieal  qaaatity  that  aaat  ba  daaeribad  ia  tba 
aarviea  tiaa.  It  ia  aaaally  aaaaaad  that  tba  aarvioa  tiaaa  ara 
iadapaadaat  raadoa  variablaa  all  baviag  tba  aaaa  PDP.  Tba  aarviea  tiaa 
PDF  ia  daaotad  by  B(t)  aad  dafiaad  to  ba: 

B(t)  -  P[aarviea  tiaa  ±  rl.  (1.3) 
Agaia  it  aay  ba  aaeaaaary  to  partitioa  tba  oaatoaara  iato  elaaaaa  aad 
dafiaa  a  aarviea  tiaa  diatribatioa  for  aaeb  elaaa. 

Oaa  aaat  apaeify  a  variaty  of  additioaal  qaaatitiea  ia  ordar  to 
idaatify  tba  atraetara  aad  diaeipliaa  of  tba  aarviea  eaatar.  Tba  firat 
of  tbaaa  ia  tba  aaabar  of  parallal  aarvara  at  tba  aarviea  caatar. 
Aaotbar  ia  tba  availabla  atoraga  eapaeity  to  bold  additioaal 
eaatoaara.  Oftaa  tbia  qaaatity  ia  aaaaaad  to  ba  iaflaita.  Still  aaotbar 
apaeifieatioa  ia  tba  eaatoaar  population.  That  ia  tba  aaxiaaa  aaabar  of 


easterner*  that  earn  siaultaneously  require  service,  Again  thie  quantity 
is  often  assuaed  to  be  infinity.  In  addition  to  these  it  aay  be 
necessary  to  specify  the  service  discipline  or  order  in  which  customers 
arc  served.  Typical  service  disciplines  are  first-eoae  first-served 
C PCFS ),  laet-coae  first-served  (LCFS).  processor  sharing  (round-robin), 
and  priority. 


The  shorthand  notation  A/B/a/K/M  is  eoaaonly  used  to  describe  s 
queueing  systea  consisting  of  a  single  service  center.  Here  A  describes 
the  interarrival  tiae  distribution.  B  the  service  tine  distribution,  a 
the  nuaber  of  parallel  servers.  K  the  syetea's  storage  capacity,  and  M 
the  oustoaer  population.  If  any  of  the  descriptors  are  absent,  then  it 
is  assuaed  that  they  take  the  value  of  infinity.  Thus,  if  it  is  assuaed 
that  the  storage  capacity  and  custoaer  population  arc  infinite,  only 
the  first  three  descriptors  are  required.  The  following  is  a  list  of 
well-aeoepted  symbols  for  distributions: 

M  Exponential  distribution  (i.e..  Markovian) 

D  Deterainistic  variable,  a  constant 

k-stage  Erlangian  distribution 
B^  k-stage  hyperexponential  distribution 

0  General  distribution. 

For  exaaple.  the  notation  M/D/1  iaplies  a  single  server  systea  with 


exponential  arrivals  and  a  constant  (deterainistic)  service  tine 


Probably  the  siaplest.  yot  the  aost  important  foraula.  in  queoeiag 
theory  is  Little's  lav  [LITT61].  It  stataa  that  tha  aaaa  raspoaaa  tiaa 
E,  ia  equal  to  tha  aaaa  qaaaa  laagth  L,  divided  by  tha  aaaa  arrival 


rata  X.  That  is. 


(1.4) 


To  ahov  that  Littls's  lav  ia  valid,  ooaaidar  Figure  1.4  vhich  is  a 
plot  of  tha  auaber  of  custoasrs  ia  a  aerviea  caatar  verses  tiaa. 


N<«> 


Figure  1.4  Plot  of  Castoaers  versos  Tiaa  ia  a  Typical  Service  Canter. 

Let 

N(t)  -  tha  auaber  of  custoasrs  ia  tha  systaa  at  tiaa  t, 

o(r)  “  tha  auaber  of  oustoaars  that  arrive  ia  tha  iaterval  [O.t], 

C(r)  “  tha  area  uader  tha  curve  ia  iaterval  [O.t]. 


During  tli*  iatiml  [0,t]  the  aean  arrival  rat*  ia 


X  -  Ail l. 
x 

and  th*  a*an  auab*r  of  euatoaars  ia  th*  ayatea  ia 


L  -  i  f  N(t)  dt  -  iill  • 

T  Jo 


(1.5) 


(1.0 


Th*  ar*a  aad*r  th*  eurv*  daring  thi*  interval  equal*  th*  total  nuaber 
of  ouatoa*r-**oond*  apent  in  the  ayatea  by  the  o(t)  euatoaer*.  If  the 
nuaber  of  euatoaer*  in  the  ayatea  at  t  equal*  the  the  nuaber  of  initial 
euatoaer*,  then  the  aean  tia*  apent  in  th*  ayatea  per  euatoaer  ia 


W 

«(t) 


Hence, 


L 

X 


g(t) 

T 


x  m  500  _ 

o(t)  a(r) 


H  . 


(1.7)  - 


(1.8) 


The  atipulation  that  the  interval  be  ehoaen  aueh  that  the  nuaber 
of  initial  and  final  ouatoaera  ia  the  ayatea  be  equal,  ia  nothing  aore 
than  th*  ateady-atat*  or  equilibriua  condition.  That  ia,  over  the  long- 
run  the  nuaber  of  ouatoaera  that  flov  into  a  ayatea  auat  equal  the 
nuaber  of  ouatoaera  that  flov  out  of  th*  ayatea.  Thi a  iaplie*  that  the 
throughput  equal*  th*  arrival  rat*.  Thu*  Little’*  lav  can  be  alao  be 
ezpreaaed  a* 


L 

E  -  -  , 
T 


(1.9) 


vhere  T  repreaenta  the  throughput.  There  are  no  atandard  notation*  in 
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queueing  theory,  hence  different  enthors  nee  different  symbols  to 
represent  the  quantities  in  Little's  lev.  Although  the  same  syubols 
often  appear  in  usage  by  different  authors,  they  are  used  to  syabolize 
different  quanties.  In  order  to  avoid  oonfusion,  the  second  expression 
will  almost  always  be  used  in  this  text  since  the  letters  have 
intuitive  meaning. 

It  is  important  to  emphasize  that  Little's  law  does  not  depend  on 
any  specific  assumptions  regarding  the  arrival  or  service  time 
distributions,  nor  does  it  depend  on  the  number  of  servers  or  the  order 
in  which  customers  are  served.  It  holds  for  any  system  in  which 
customers  arrive,  wait  for  service,  and  depart.  It  does  not  matter  if 
the  system  is  composed  of  a  single  service  center  or  a  collection  of 
service  centers.  In  fact  Little's  law  can  even  be  applied  to  parts  of  a 
service  center.  For  example,  if  L^  is  the  number  of  customers  waiting 
to  be  served  and  the  mean  waiting  time,  then  L^  “  XW^. 

1.6  Utilization 

The  utilization  of  a  service  center  is  the  average  amount  of 
service  required  divided  by  the  maximum  amount  of  service  that  can  be 
provided.  If  the  arrival  and  service  processes  are  independent  of  each 
other  and  of  the  number  of  customers  in  the  system,  then  on  the  average 
X  customers  arrive  per  second,  and  each  customer  requires  E[S]  seconds 
of  servioe.  Thus  the  average  amount  of  service  required  per  seoond  is 
XE[S].  Now  for  a  single-server  system,  the  maximum  amount  of  service 
that  can  be  provided  is  one  second  of  service  per  second.  Hence,  the 
utilization  (denoted  by  p)  of  a  single-server  system  is 


For  a  service  .center  vita  ■  servers  the  siiisu  amount  of  service  that 
can  be  provided  is  ■  seconds  of  service  per  seeoad.  Therefore*  the 
utilization  for  a  Multi-server  system  is 


XE[S] 


(1.11) 


Clearly,  for  a  single-server  systea,  the  ntilixatioa  is  the 
proportion  of  tiae  the  server  is  busy.  Similarly,  for  a  multi-server 
systea,  utilization  ia  the  average  proportion  of  time  the  servers  are 
busy.  Since  Pk  is  the  long-run  proportion  of  tiae  the  systea  contains  k 
cnstoaers,  Pq  is  the  long-run  proportion  of  the  tiae  that  the  systea  is  «. 
eapty  or  not  busy.  Nov  since  the  summation  of  the  P^’s  over  all  k  aust 
equal  one,  the  proportion  of  tiae  that  the  system  is  busy  is  1-Pft.  Thus 


for  a  single-server  systea  utilization  oan  be  expressed  as 

p  -  1-P0  . 


(1.12) 


Similar  results  oan  be  obtained  for  a  multi-server  service  center.  More 


precisely. 


P  -  i  -  Po  -  i  }  <**>  *k  • 

A 


(1.13) 


This  follovs  froa  the  fact  that  vhen  the  service  center  contains  k 
cnstoaers  (m-k)/a  is  the  capacity  of  the  service  center  that  is  not 
utilised.  The  last  tvo  equation  for  p  are  more  general  than  the  first 
tvo,  in  that  the  arrival  rate  does  not  appear  explicitly  and, 
therefore,  it  nay  be  a  function  of  the  number  of  customers  in  the 
systea. 


Obviously,  the  utilization  of  a  service  center  nust  be  leas  than 
one.  That  is,' for  the  system  to  be  stable,  the  aean  service  deaand 
oannot  exceed  the  capacity  of  the  systea  to  provide  service.  If  the 
systea  is  not  stable,  then  as  t  approaches  infinity,  the  queue  length 
grows  without  bound  and  the  liaiting  probabilities  do  not  exist. 

1.7  Outline  of  Contents 

The  purpose  of  this  short  chapter  was  to  introduce  queueing  theory 
and  soae  of  the  terainology  that  will  be  used  in  the  following 
chapters.  The  next  chapter  is  a  mathematical  treatment  of  Markov 
processes.  The  tools  developed  in  this  chapter  fora  the  basis  of 
queueing  theory  analysis.  Chapter  3  is  the  analysis  of  Markovian 
queues,  M/M /a.  Chapter  4  is  the  analysis  of  seai-Markovian  queues. 
M/G/l  and  G/M/l.  Chapter  S  la  an  introduction  to  queueing  network 
theory  (Jackson  type  networks).  Chapter  6  is  advanoed  queueing  network 
theory.  Chapter  7  is  coaputstion  algorithms  for  closed  and  nixed 
networks.  Finally,  Chapter  8  points  out  the  liaitations  of  queueing 


theory  and  open  areas  of  resesrch. 


CHAPTER  2 


MARKOV  PROCESSES 


2.1  Ran doa  Variables 
A  randoa  variable,  X,  ia  a  variable  whoee  value  depends  on  the 

outcoae  of  a  randoa  ezperiaent.  The  ontcoae  of  the  ezperiaent  assigns  a 
value  to  X.  The  set  of  all  possible  outcoaes  of  an  ezperiaent  is  known 
as  the  saaple  space  of  the  ezperiaent  and  is  denoted  by  S.  Each  outcoae 
's'  in  the  set  S  is  referred  to  as  a  saaple  point.  Thus  a  randoa 
variable  is  nothing  aore  than  a  function  defined  on  the  saaple  space  of 
a  randoa  ezperiaent.  Therefore,  the  syabol  for  a  randoa  variable  should 
be  {X(s):ssS},  denoting  the  dependence  of  X  on  the  saaple  space,  but  it 
is  custoaary  to  use  the  short  hand  notation  X. 

2.2  Stochastic  Processes 

A  stochastic  process,  (X(t,  s) :  t sT,  seS}  is  a  faaily  of  randoa 
variables  that  describes  the  evolution  through  tine  of  soae  process. 
The  syabol,  (X(  t,  s) :  t  sT,  s  sS} ,  indicates  that  it  is  a  set-function  of 
two  variables.  The  set  T  represents  tiae,  and  is  often  referred  to  as 
the  indez  set  since  for  each  tsT  (a  specific  value  of  t),  X(t,s) 
reduces  to  a  randoa  variable  (note  that  in  this  chapter  and  only  in 
this  chapter,  the  variable  T  will  represent  tiae  and  not  throughput). 
Thus,  the  variable  t  induces  a  set  or  faaily  of  randoa  variables.  The 
set  S  represents  the  saaple  space  of  these  randoa  variables,  and  s  is  a 


saaple  point  in  S.  Just  as  it  is  custoaary  to  use  the  syabol  X  for  s 


randoa  variable  rather  than  {X(s):seS},  it  ia  also  custonary  to  drop 
the  a  in  the  notation  of  a  stochaatio  prooeaa.  That  ia,  the  traditional 
ayabol  for  a  atoohaatio  prooeaa  ia  {X(t):teT}  [PARZ62],  [THOM69], 
[ROSS80] . 

There  are  tvo  other  notationa  that  are  naed  to  denote  apecial 
atoohaatio  proeeaaea.  If  the  aet  T  ia  finite  or  countable,  then  the 
prooeaa  ia  aaid  to  be  a  discrete-tiae  atoohaatio  prooeaa.  A  countable 
aet  ia  one  in  which  there  exiata  a  one-to-one  oorreapondence  between 
each  eleaent  of  the  aet  and  the  nonnegative  integera.  Therefore,  a 
discrete-tiae  atoohaatio  prooeaa  is  a  sequence  of  randoa  variables 
indexed  by  the  set  T.  When  the  sequence  ia  infinite  but  countable,  the 
process  ia  often  represented  by  {Xn,n-0,1,2,...}.  If  on  the  other  hand, 
the  set  T  consists  of  all  points  on  a  continuous  interval  of  the  tine 
axis,  the  process  is  called  a  continuous-tine  stochastic  process.  If 
the  interval  consists  of  the  entire  positive  tiae  axis,  then  frequently 
the  short  hand  notation  X(t)  is  used  to  represent  the  process. 

Stochastic  prooeaaes  are  also  classified  according  to  the  set  S. 
The  set  S  is  called  the  state  spaoe,  and  it  consists  of  all  possible 
values  (states)  that  the  randoa  variables  nay  assuae.  If  S  is  finite  or 
countable,  the  process  is  said  to  be  a  discrete-state  process. 
Otherwise  it  is  said  to  be  a  continuous-state  process. 

If  Xn*i,  then  the  process  is  said  to  be  in  state  i  at  tine  n,  or 
for  the  continuous-tiae  case  if  X(t)“i  the  process  is  in  state  i  at 


inc 


.or 


A  Markov  procaaa  it  a  atoohaatio  prooaaa  that  haa  no  'aeaory*. 
Tkia  aeans  that  inforaation  about  how  the  proeeas  reached  a  certain 
state  plays  no  roll  in  assigning  probabilities  to  the  next  or  fntnre 
states.  Only  discrete-state  Merkow  processes  will  be  discnssed  in  this 
text. 


2.4  Discrete-State.  Discrete-T 


rkow  Procesae 


A  discrete-state,  discrete-tine,  Markov  proeeas  is  a  stochastic 
process  {Xa,ns0,l,2,...}  such  that: 

^WJl^^’Vl^n-l . Xj-i^Xg-ig]  “  (2.1) 

for  all  states  ig, i^...., ia.^, i, j,  and  all  n^O.  In  other  words,  the 
probability  of  any  fntnre  state  Xa+1,  given  present  state  Xa  and  the 
past  states  Xn-1,...,Xj,Xg,  depends  only  on  the  present  state  and  is 
independent  of  the  past  states.  Discrete-tiae  Markov  processes  are 
often  referred  to  as  Markov  chains. 

If  the  probabilities  are  tiae-invariant,  that  is  independent  of  n, 
then  the  process  is  referred  to  as  a  hoaogeneons  Markov  process.  For  a 
hoaogeneons  Markov  process,  let  P^j  denote  the  probability  of  going 
froa  state  i  to  j  in  one  step.  That  is. 


PCXa+1-j|X  -i]  . 


The  probability  of  going  froa  any  state  to  another  state  in  one  step 
can  be  described  by  the  aatrix 


I 


where  the  row  index  it  the  present  state  and  the  eoltai  index  the  next 
state.  The  aatrix  [P]  is  called  the  one-step  transition  natrix. 

Let  denote  the  probability  that  a  process  goes  from  state  i 
to  state  J  in  two  steps.  In  order  to  go  froa  state  i  to  state  j  in  two 
steps,  the  process  anst  go  to  soae  interaediate  state  k  in  the  first 
step  and  proceed  to  state  j  in  the  next  step.  Therefore, 


pij2  “  )  Pik  PkJ 
k-0 


Pi0  P0j  +  Pil  Plj  +  Pi2  P2j  + 


(2.4) 


This  equation  can  be  interpreted  as  the  weighted  average  of  going  to 
state  j  in  one  step,  given  the  process  was  in  state  k,  weighted  by  the 
probability  of  being  in  state  k.  The  two-step  transition  astrix, 
denoted  by  [P*],  can  be  found  froa  the  one-step  aatrix  [P]  by  observing 
that  the  two-step  transition  P^j  i*  the  sua  of  the  eleaents  along  the 
ith  row  aultiplied  by  the  eleaents  along  the  jth  coluan.  Hence,  the 


two-step  transition  aatrix  is 


IP2]  -  tP] CP]  -  [P]2  . 


(2.5) 


It  follows  that  for  a  process  to  go  froa  stste  i  to  j  in  n+a 
steps,  it  aust  go  to  soae  interaediate  state  k  in  n  steps  and  proceed 
to  state  j  in  a  steps.  Therefore, 


m. 

m 


(2.0 


Pij"**  '  }  Ptt"  Pkj*  - 
k-0 

The  last  aquation  ia  called  the  Chapaan-Kolaogorov  equation.  When  n»l, 
the  equation  ia  referred  to  aa  the  baokward  Chapaan-Kolaogorov 
equation,  since  it  is  written  at  the  backwards  aoat  end  of  the 
interrsl.  More  precisely,  the  backward  Chapaan-Kolaogorov  equation  is 

PiJ1+*  '  }  pik 
k-0 

-  PiO  P»j*  ♦  Pil  *1}'  *  *11  *i!m  *  •••  •  (2-7> 

Note  that  ike  ana  of  the  eleaents,  along  the  ith  row  of  the 

one-step  transition  aatrix,  aultiplied  by  the  eleaents  along  the  jth 
col nan  of  the  a-step  aatrix.  Hence, 

[P14*]  -  IP]  IP-]  .  (2.8) 

If  a  equals  two,  then  the  three-step  transition  aatrix  is  just  the 
one-step  aatrix  tiaea  the  two-step  aatrix,  which  is  the  one-step  aatrix 
raised  to  the  third  power.  Recursively  it  follows  that  the  nth-step 
aatrix  is  jnst  the  one-step  aatrix  raised  to  the  nth  power.  That  is, 

[P®]  -  [P]B  .  (2.9) 

The  saae  results  can  be  derived  by  letting  a-1.  More  precisely. 


pij"*1  -  }  fik*  Pkj 

k-0 


-piOapOj  4Piiapij  +Pi2ap2j  +  *•'  * 


(2.10) 


or  in  aatrix  fora 


18 


Ipa+1]  .  fpttj  [P]  .  (2.11) 

When  «*1  the  -Chapnan-Kolaogorov  equation  ia  referred  to  aa  the  foreard 
Chapnaa-Iolnogorov  equation,  since  it  is  written  at  the  forward  noat 


end  of  the  interval. 

The  unconditional  probability  of  being  in  state  j  after  n  steps, 
denoted  by  Pjn,  is  the  weighted  average  of  going  to  state  j  in  n  steps, 
given  the  initial  state  was  k,  weighted  by  the  probability  of  state  k 
being  the  initial  state.  Therefore, 


PJ°  -  1  pt°  pkj' 


,pOp  u.pOp  n.  pOp  n  .  . . . 
■p0  P0j  +  P1  Plj  +  P2  P2j  + 


(2.12) 


where  Pk°  is  the  probability  of  initially  being  in  state  k.  Let  V° 
equal  the  vector  of  initial  state  probabilities,  and  let  yn  equal  the 
vector  of  state  probabilities  after  n-steps.  The  unconditional 
probabilities  in  vector  fora  are 

Va  -  V°  [Pn]  (2.13) 


»  0  p  0  p  0  ...i 

0  **1  *r2  *  J 


i  n  p  n  p  n  ...- 
0  *rl  *r2  * 


an  initial  state  probability  vector  and  the  one-step  transition  natrix, 
one  can  find  the  n-step  probability  vector,  that  is,  the  probabilities 
of  where  the  process  will  be  n  steps  after  start-up. 

2.4.1  Liaitlna  Probabilities 

When  a  process  first  starts  up,  its  initial  state  certainly  has  a 
large  influence  on  the  current  state,  but  what  about  after  the  process 


IS8 

I 


1 


(2.13) 

given 

•  ..■'.MBS 

fSi 


SSSu 

KjSJjJh 

DgQJv 

wife 


i 
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has  been  operating  for  a  long  tine?  It  seeas  reasonable  to  expect  that 
as  tine  increases  the  influence  of  the  initial  state  shonld  decrease. 
More  specifically,  does  the  lisiit  of  PjB  as  n  approaches  infinity, 
converge  to  soae  value,  say  Pj,  which  is  independent  of  the  initial 
state,  and  do  the  Pj's  fora  a  probability  systea?  The  answers  to  these 
questions  are  that  it  depends  on  the  prooeas. 

In  order  to  define  when  the  liaiting  probabilities  exist,  it  is 


first  neeessary  to  disci 


terainology  of  Markov  chains.  A  Markov 


chain  is  said  to  be  irreducible  if  every  state  can  be  reached  froa 
every  other  state.  More  precisely,  for  each  pair  of  states  (i  and  j) 
there  aust  exist  an  integer  a  (  which  any  depend  upon  i  and  j  )  such  ^ 
that  Pjj*  >  0.  Furtheraore,  state  i  is  said  to  have  period  n  if,  when 
in  state  i,  the  only  possible  steps  at  whioh  the  prooeas  can  return  to 
state  i  are  n,2n,3n,...,.  If  n  «  1  then  state  i  is  aperiodic.  It  can  be 
shown  that  all  states  of  an  irreducible  Markov  chain  have  the  saae 
period  [R0SS80]. 

The  following  theorea  states  when  the  liaiting  probabilities 
exist:  (1)  In  an  irreducible,  aperiodic,  hoaogeneous,  Markov  chain  the 


liaiting  probabilities 


P,  -  lia  P,a  -  lia  ?i{n 
J  J  n.— *  •  *J 


(2.14) 


always  exist  and  are  independent  of  the  initial  state  probabilities. 
(2)  If  the  chain  is  finite,  then  the  liaiting  probabilities  fora  a 


probability  systea.  That  is, 

0iP.il 


1  for  all  j. 


(2.15) 


ivjC: 


is 
m 
4. 


(3)  If  the  chain  is  infinite,  the  limiting  probabilities  nap  or  nay  not 
form  a  probability  system,  bnt  if  they  do  not  then  Pj  ■  0  for  all  j. 
The  interested  reader  is  referred  to  [FELL66]  for  a  proof. 

Assnaing  that  the  liniting  probabilities  do  exist,  it  is  easy  to 
show  that  they  are  independent  of  the  initial  state.  The  unconditional 
probability  that  the  process  is  in  state  j  at  step  n  can  be  expressed 
as 

-  j  Pk“~1  **kj  »  (2.16) 

k-0 


or  in  rector  form 

vn  „  yn-l  [p]  #  (2.17) 

By  taking  the  linit  of  these  equations  as  n  approaches  infinity  ,  one 
arrives  at 

* 

Pj  -  5  *k  pkj  <2-i8> 

k»0 

or  in  vector  fora 

V  -  V  [P]  (2.19) 

where  V  -  [po*Pl»P2****^  .  Therefore,  the  Uniting  probabilities  are 
independent  of  the  initial  state  of  the  process.  Equation  (2.18)  or 
(2.19)  along  with  the  conservation  of  probability  equation  (suaaation 
of  Pj's  equal  one)  uniquely  determines  the  liaiting  probabilities  when 
they  exist. 

It  can  also  be  shown  that  when  the  liaiting  probabilities  exist 


then 


lia  P,,1 
n—  •  ‘J 


(2.20) 


The  equivalent  stateaent  in  aatrix  fora  is  that  as  n  approaches 
infinity  the  n-step  transition  aatrix  approaches  a  aatrix  in  which  each 
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/.v. 


V  V'  .  .  . 


►.V> 


row  approach* s  tha  vector  V.  That  is, 

11a  [P*]  -  [V]  .  (2.21) 

Tha  liait  of  Equation  (2.13)  aa  a  approaohaa  infinity  la 

V  -  V°  11a  [P“]  .  (2.22) 

n—» 

Tha  initial  atata  vector,  V®,  appear*  explicitly  in  thia  aquation,  and 
aiaca  it  ia  alwaya  true  that  tha  aleaanta  in  V®  fora  a  probability 
ayatea,  than  the  only  way  that  tha  aquation  can  hold  and  b*  independent 
of  V°  ia  if 

lia  [P11]  -  [V].  (2.23) 

Tha  Halting  probabilitie*  are  alao  called  tha  ateady-atata 
probabilitiea,  ainca  they  represent  the  state*  of  tha  process  after  tha 
affects  of  the  initial  conditions  have  died  oat.  It  is  iaportant  to 
understand  that  as  n  approaches  infinity  tha  process  still  novas  fron 
state  to  state,  and  hence  tha  Uniting  probabilities  equal  the  long-run 
proportion  of  tin*  the  process  spends  in  each  state. 

Discrete-State.  Continuous-Tine,  Markov  Processes 
A  discrete-state,  oontinuous-tin*  Markov  process  is  a  stochastic 
prooess  (X(t),t2.0)  such  that  for  all  s,t2.0  and  nonnegative  integers 
i» J  #*(u) ,0£a<s 

P[X(t+s)-j|X(s)-i.X(u)-x(u),Oiu<s]  -  P[X(t+s)-j|X(s)-i]  .  (2.24) 

That  is,  the  probability  of  the  future  X(t+s)aj  given  the  present  X(s) 
and  past  X(u),0.£u<s,  depends  only  on  the  present  and  is  independent  of 
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the  past.  If  in  addition, 


P[X(t+s)-j|X(s)-i]  (2.25) 

ia  indapandant  of  s.  than  the  prooaaa  is  said  to  ba  stationary  or 
hoaogeneous.  Only  homogeneous  Markov  prooassas  will  ba  considered  in 
this  text. 

Since  the  past  history  includes  how  long  the  process  has  been  in 
current  state*  the  definition  requires  that  the  anonnt  of  tine  in  the 
current  state  and  the  next  state  visited  anst  be  independent  randoa 
variables.  The  definition  also  requires  that  if  Tj  is  the  randoa 
variable  representing  the  aaonnt  of  tine  in  state  i,  then  the 
probability  distribution  function  (PDF)  of  Tj  anst  be  'aenoryless'.  In  _ 
other  words,  the  aaonnt  of  tiae  in  state  i  oannot  affect  the 
probability  of  when  the  the  process  will  depart  state  i.  The  aenoryless 
stateaent  in  aatheaatical  terns  is 

P[T1>t+s|Ti>s]  -  P[Ti>t]  .  (2.26) 

The  only  PDF  which  has  this  property  is  the  negative  exponential. 

Fj( t)  -  PlTj.it]  -  l-e"?it  (2.27) 

where  l/(j  is  the  expected  value  of  Tj.  The  subscripts  indicate  that  Tj 
nay  depend  on  the  state  i. 

The  following  shows  that  this  distribution  function  has  the 
aenoryless  property.  The  condition  in  Equation  (2.26)  is  equivalent  to 

P[Ti>t+s|Ti>s]  P[T1>s]  -  P[Tj>t]  P[Tj>s]  (2.28) 

or 

P[Ti >t+s]  -  PIT. >t]  PIT. >s]  .  (2.29) 


it  follows  that  the  negative  exponential  satisfies  the  condition  in 
Equation  (2.29).  and  therefore  has  the  aeaoryless  property. 


The  following  proves  that  it  is  the  only  distribution  function 
with  the  aeaoryless  property.  The  derivative  of  Equation  (2.29)  with 
respect  to  s  is 


dP[Ti>t+s] 

ds 


PlT^t] 


dPET^s] 

ds 


(2.31) 


For  any  PDF 

dP[Ti>s]  dtl-PHYia]} 

-  -  -  -  -f,(s)  ,  (2.32) 

da  ds 

where  f  j(s)  is  the  probability  density  function  (pdf).  Substituting 
(2.32)  into  (2.31)  yields 

dP[Tj>t+sl 

- i - -  -f^s)  PtTjH]  .  (2.33) 

ds 

By  dividing  both  sides  of  this  equation  by  P[Ti>t]  and  letting  s«0,  one 
obtains 

dP(T1>t] 

-  -  -f^O)  ds  .  (2.34) 

PIT^t] 

It  follows  by  integrating  froa  0  to  t  that 


Logj  P[Ti>t]  -  -fi(0)t  . 

(2.35) 

P[T1>t]  -  e"fi(0)t. 

(2.36) 

PIT^t]  -  1-  e“fi(0)t. 

(2.37) 

Thus,  the  negative  exponential  is  the  only  PDF  with  the  'aeaoryless’ 


property. 

This  connection  is  so  strong  that  the  definition  of  s  homogeneous 
continuous-time  Markov  process  can  be  given  in  terms  of  it.  Namely,  it 

is  a  stochastic  prooess  having  the  properties  that  eaoh  time  it  enters 

state  i  : 

(1)  the  amount  of  time  it  spends  in  state  i  is  exponentially 
distributed  with  mean  l/$£,  and 

(2)  vhen  the  process  departs  state  i,  it  enters  state  j  according 
to  probability  p^j.  Of  oourse,  the  p^j  must  satisfy 

Pii  ■  0  for  all  i 

^  Pij  -  1  for  all  i  .  (2.38) 

j 

For  a  homogeneous,  continuous-time  Markov  prooess,  let  PAj(t) 
denote  the  probability  of  going  from  state  i  to  state  j  in  time  t.  More 
precisely, 

PijCt)  -  P[X(t+s)-j|X(s)-i]  for  s.t  2  0  .  (2.39) 

Pjj(t)  is  analogous  to  the  discrete-time  n-step  transition  probability 
P|j°.  The  difference  is  that  the  discrete  parameter  n  has  been  replaced 
by  the  continuous  parameter  t.  In  other  words,  P^jn  is  the  probability 
of  going  from  state  i  to  state  j  in  n-steps,  and  P^j(t)  is  the 
probability  of  going  from  state  i  to  state  j  in  time  t. 

Since  by  definition  P^j(t)  is  independent  of  s,  then  P^j(t)  is 

also  the  conditional  probability  that  the  process  is  in  state  j  at  time 

t,  given  that  it  was  initially  in  state  i  at  time  0.  That  is. 


P^U)  -  P[X(t)-j|X(0)-i] 


(2.40) 


Let  Pj(t)  denote  the  onoonditionel  probability  that  the  prooeaa  ia  in 
atate  j  at  tine  t.  More  precisely. 


Pj(t)  -  J  P[X(t)-j|X(0)«i]  P[X(0)-i]  .  (2.41) 

i-0 


It  follows  that 

m 

pj(t)  -  5  piJ(t>  Pi(o) 
i-0 

-  P0(0)P0j(t)  +  P^O^jU)  +  P2(0)P2J(t)  +  •••  .  (2.42) 

As  in  the  case  of  the  discrete-tine  Merkow  process,  these  probabilities 
can  be  expressed  in  vector  and  matrix  form.  That  is, 

V(t)  -  V(0)  [P(t)l 

where 
and 
and 


[P(t)l  - 


V(t) 

m 

tpo 

(t),P2(t) 

,P2(t) 

•  • 

• 

•1. 

V(0) 

m 

tp0 

(0),P1(0) 

,P2(0) 

•  • 
9 

•1. 

P00  * t ) 

P01 

(t) 

P02^ 

P0j 

(t) 

Pio(t) 

pll 

(t) 

• 

pi2(t) 

• 

e  e  e 

P1J 

(t)  •*' 

•  e  e 

e 

PiO(t> 

pil 

it) 

■ 

?u(t> 

•  e  e 

PU 

it) 

e  e  e 

(2.43) 


Henoe  given  V(0)  and  [P(t)l,  the  unconditional  probabilities  of  where 
the  prooess  is  at  tine  t,  V(t),  can  be  conpnted.  The  only  reaaining 
problen  is  deternining  [P(t)l. 

In  the  disorete-tiae  Markov  chain  P^jB  *■<  derived  froa  the 
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Chapaaa-Kolaogorov  equation. 


Pija+"  “  }  Pik“  Pkj* 
k-0 


(2.6) 


and  a  aiailar  procedure  will  be  need  here.  In  order  for  a  continuous— 
tiae  Markov  prooees  to  aake  a  transition  froa  state  i  to  state  j  in 
tiae  h+t,  it  anst  go  to  soae  state  k  in  tiae  h  and  then  proceed  to 
state  j  in  the  reaaining  tiae  t.  Therefore, 


Pi j (h+t)  -  J  *ik<h>  pkj(t>  * 
k=0 


(2.44) 


This  equation  is  the  oontinnons-tiae  equivalent  of  the  Chapaaa- 
Kolaogorov  equation.  By  writing  ont  the  k-i  tera,  subtracting  Pjj(t) 
froa  both  sides,  dividing  by  h  and  taking  the  liait  as  h  approaches 
zero,  one  arrives  at 

jLi.  pvfc+t)  -  Pij(t)i .  ^  rpila»)piJ(t)  -  Pij(t)  +  ^  plk<h>  pkj<t>] 

L  h  J  1  h  k-0  h  J 

Wi 

.  (2.45) 

The  left  hand  side  is  the  derivative  of  P|j(t)  with  respect  to  tine. 
With  the  assnaption  that  the  liait  and  snaaation  can  be  interchanged 
one  has. 


dPiJ(t>  -  Jijj  [Pii^-1]  ?ij(t)  +  J  £ifl  |[Pik<h)j  Pkj(t)  . 


(2.46) 


Wi 


Now  let 


-  ■ »  m . 


(2.47) 
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Hik  h-0 


for  kv i . 


(2.48) 


Substituting  (2.47)  and  (2.48)  into  (2.46)  gives 


dPlJ(t)  “  <lii  Pij(t)  +  J  qik  Pkj(t)  . 
dt  k-0 

Wi 


(2.49) 


This  equation  is  known  as  the  Chapman-Kolmogorov  backwards  differential 
equation. 

Equations  (2.47)  and  (2.48)  have  the  following  interpretations: 
For  small  values  of  h  the  probability  that  the  process  makes  a 
transition  out  of  state  i  is  approximately  1+q^h.  More  precisely, 

Pu(h)  -  1  +  quh  +  o(h)  .  (2.50) 
The  notation  o(h)  represents  any  function  that  goes  to  aero  faster  than 
h.  That  is. 


1*^-0  . 

A 


(2.51) 


It  should  be  obvious  that  q^  must  be  negative.  In  fact  To 
show  this,  recall  that  the  time  spent  in  state  i  is  exponentially 
distributed  with  mean  1/$^.  Hence  for  small  values  of  h 


PH(h)  -  P[Ti>h]  -  e"*ih 


1  -  «4h  ♦ 


(?th)2  (?th)3 


1  -  $,h  +  o(h) 


(2.52) 


The  interpretation  it  that  when  the  prooeaa  is  in  state  i,  it  departs 
at  aean  rate  -q^. 

Similarly  for  snail  values  of  h  the  probability  that  the  process 
■  ales  a  transition  to  state  k,  given  that  it  is  onrrently  in  state  i, 
can  be  approximated  by  q^k  h.  More  precisely, 

Plk(h)  -  qik  h  +  o(h)  .  (2.54) 

The  interpretation  is  that  when  the  process  is  in  state  i,  the  rate  of 
flow  to  state  k  is  q^k.  For  snail  values  of  h,  Pik(h)  is  the 
probability  that  there  is  a  transition  fron  state  i,  and  the  transition 
is  to  state  k.  Since  these  two  events  are  independent 

Pik(h)  -  PtT^h]  pik  -  (1  -  e“?ih)  pik 

<«i«2  Ujh)3 

-  (1  -  (1  -  +  — - ”’))  Pik 

-  (^h  +  o(h))  pik 

-  <?i  Pik  h)  +  o(h)  (2.55) 

where  pik  is  the  probability  the  transition  is  fron  i  to  k,  and  again 
o(h)  picks  up  all  terns  with  powers  of  h.  Hence, 

q^k  ”  5^  Pjk  .  (2.56) 

Since  is  the  conditional  rate  of  flow  fron  state  i,  then  pik  must 
be  the  conditional  rate  of  flow  fron  i  to  j.  It  follows  that 


I 


As  in  the  disorets  osas,  there  is  also  a  forward  Chapaan- 
Kolaogorov  equation.  The  forward  differential  equation  is  derived  by 
interchanging  t  and  h  in  Equation  (2.44),  writing  out  the  k*j  tera  and 
following  the  procedure  for  backwards  differential  equation.  The 
results  is 


dPij(t)  "  PjjU)  qH  +5Pik(t)qkj 
dt  k-0 

Wj 


(2.S8) 


where 


-  lit  f„  ^  -  a  . 


Both  the  backwards  (2.49)  and  forward  (2 .38)  equations  define  a 
set  of  differential  equations  which  can  be  put  into  vector  fora  by 


defining  [Q]  as 


US  [ 


[P<t)]-[I1 


(2.59) 


where  [I]  is  the  identity  aatriz.  The  aatriz  [Q]  is  called  the  rate 
aatriz.  The  resulting  backward  aatriz  equation  is 


-  CPU)]  [Q]  , 

ttt 


(2.60) 


and  the  resulting  forward  aatriz  equation  is 


-  [Q1  IP(t)l  . 

at 


(2.61) 


Since  both  equations  describe  the  saae  process,  they  both  hsve  the  sane 


solutions.  The  initial  conditions  for  the  equstions  are 


I, 


■„»>  ■  {: ;; ;; 


(2.62) 

or  in  aatriz  fora  [P(0)1  -  [I].  The  initial  conditions  siaply  state 
that  if  the  process  is  in  state  i  at  any  given  tine,  it  is  also  in 
state  i  zero  tine  nnits  later. 

Hence,  a  set  of  differential  equations  can  be  written  and  the 
transition  probabilities  calculated.  The  solution  to  the  natriz 
equation  is 

[P(t)]  -  elQlt 

where 


eIQlt  -  [II  +  [Q]t  + 


[Q]2t2  [Q]3t3 
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3! 


(2.63) 


These  equations  provide  a  fornal  solution.  In  practice  this  aethod  is 
often  so  cuabersoae  that  alternate  nethods  aust  be  sought  [CLAR70]. 

Recall  that  the  priaary  purpose  of  finding  P^t)  was  to  deternine 


Pj(t).  That  is. 


Pj(t)  -  5  Pij(t)  Pi(0) 
i-0 


(2.64) 


The  derivative  of  this  equation  is 


dPj(t) 

dt 


■  5  ["ij<*>l  Pt(0)  . 

i-0  1  dt  J 


(2.65) 


Substituting  Equation  (2.58)  for 


dPlj(t) 

dt 


,  yields 
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Z£l’  •  >  pij(t)  ♦  )  Pik(t)  <ikj  Pi(o> 
dt  im0  L  k“0  J 


•  «  • 

-  £  J  Pij(t)  Pi(0)J  Ijj  +  5  Pik<t)  Pi(0)J  qkj  .  (2.66) 

WJ 

Proa  Equation  (2.42)  tha  first  tern  in  brackets  it  Pj(t)  and  tbo  second 
tera  is  Pk(t).  Therefore, 


dPj(t) 


Pj(t)  qjj  +  5  Pk<*>  ^kj 
k“0 
Wj 


(2.67) 


or  in  vector  fora 


«  V(t)  [Q]  . 
dt 


(2.68) 


2.5.1  The  Poisson  Process 

Consider  the  problea  of  deteraining  the  nnaber  of  arrivals  that 
occur  in  an  interval  of  tiae  t,  given  that  the  interarrival  tiaes  (tine 
between  arrivals)  are  exponentially  distributed  vith  a  nets  of  l/(. 
Since  only  arrivals  can  occur  Pjj(t)  “  0  when  j<i  (departures  are  not 
allowed).  Since  the  probability  of  aultiple  arrivals  in  an 
inf initesiaal  interval  h  is  o(h),  it  follows  that  the  rates  are  : 


I  0  when  k ?J-1 
l{  when  k-j-1 


(2.69) 


q^  -  -t  . 


(2.70) 


The  forward  differential  equations  are  : 
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-«  Pii(t) 


(2.71) 


dP£i(t)  - 
dt 


J-i 


dPiJ(t)  -  Pij(t)  +  *  Pi,j-l(t)  J21+1  .  (2.72) 

dt 

The  solution  to  the  j-i  equation  is  obviously 

pii(t)  -  (2.73) 

The  results  of  the  j-1  equation  oan  be  substituted  into  the  j-i+1 
equation  to  obtain 

Pi.i+l(t)  -  -«  Pi.i+lt*)  +  »  (2.74) 

dt 
or 

Pi,i+l(t)  +  ?  pi,i+l(t)  -  Ce"**  .  (2.75) 

dt 

The  solution  is  easily  obtained  by  taking  the  Laplace  transforms  of 
both  sides.  More  precisely. 


Pi,i+l(S) 

and 

Pi.i+l<t> 

It  follows  by  induction  that 


J _ 

(S+?)2 

{te-**  . 


and 


PiJ<S) 

Pij<*> 


(S+5)j'i+1 
<«t)J'1  e** 
(j-iTi 


(2.76) 

(2.77) 


(2.78) 


(2.79) 


This  last  equation  is  the  celebrated  Poisson  process.  Thus,  the  Poisson 
prooess  is  a  special  case  of  the  Markov  process.  It  is  important  to 


eaphasise  that  this  also  iapliaa  that  for  a  Poisaoa  process  the  tias 
between  arrivals  is  exponentially  distributed.  The  reverse  is  also 
true,  if  the  tiae  betveen  arrivals  is  exponentially  distributed  the 
prooess  is  Poisson. 

i 

2.5.2  Continuous  Tiae  -  Liaitim  Ptoftibilitloi 

It  was  shown  in  the  ease  of  the  diserete-tiae  Markov  process  that 
under  certain  conditions  the  Uniting  probabilities  existed,  and  were 
independent  of  the  initial  state,  that  is. 


P,  -  lia  P44a-lia  P,a  .  (2.14) 

Recalling  that  the  difference  between  and  Pjj(t)  is  that  the 

discrete  paraaeter  n  is  replaced  by  the  continuous  paraaeter  t,  it 

seeas  plausible  that  for  the  continuous-tine  process 

P,  -  lia  P44(t)  -  lia  P4(t>  .  (2.80) 

J  t—  •  t— ••  J 


This  is  indeed  the  case,  and  the  conditions  for  the  liait  to  exist  are 
the  sane  as  those  for  the  discrete  case. 

To  derive  a  set  of  equations  for  P j ,  it  is  necessary  to  take  the 
liait  as  t  approaches  infinity  of  both  the  backward  and  forward 
Chapaan-Kolaogorov  differential  equation.  The  backward  equation  results 
in 

lia  dPij(t)  -  qii  lia_  Pi_|(t)  +  lia_  \  qik  PfcjU)  •  (2.81) 

!  dt  t~"  *”*"  k-0 

k#i 


If  the  liait  and  suanation  can  be  interchanged  then 


lin_  dpij(t) 
t_*"  dt 


*iipj  +  J  <Uk  pj 
k-0 
Wi 


“  pj  J  4ik 
k-0 


-  0  . 


(2.82) 


By  applying  tka  sane  procedure  to  the  forward  equation  and  using  the 


results  of  the  backward  equation,  one  obtains 


li.  dPiJ<*> 
t_*’  dt 


y*.  pij  qjj +  jif.  5  pik(t)  ^kj 

k-0 

WJ 


(2.83) 


pj  4jj  +  5  "  0 

k-0 

WJ 


(2.84) 


5  Pk  Ikj  “  0 
k-0 


(2.85) 


The  vector  form  of  Equation  (2.85)  is 


V  IQ]  -  0  . 


(2.86) 


Equation  (2.84),  or  (2.85),  or  (2.86)  along  with  the  conservation  of 


probability  equation. 


Pk  "  1 


(2.87) 


uniquely  deternine  the  Uniting  probabilities. 


Note  that  the  sane  results  could  have  been  obtained  fron  Equation 
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(2.67)  by  taking  the  Halt  as  a  approach#*  infinity  and  satting 

dPj (t) 

lia  — - - -  0  . 

- - dt 


(2.88) 


Tha  intarpratation  of  Equation  (2.84)  it  iaportant.  Eacall  that 
(-qjj)  is  tha  rata  of  flow  froa  stata  j  whan  tha  tha  procas*  is  in 
•  tata  j.  Sines  Pj  is  tha  proportion  of  tiaa  tha  proosss  is  in  stata  j* 


it  follows  that 


Pj  (~4jj)  “  cat*  at  whieh  tha 


j.  (2.89) 


Siailarly.  whan  tha  procsss  is  in  stata  k  it  goas  to  stata  j  at  rata 


q ^ j ,  tharsfor* 


Pk  qkj  -  rat*  tha  proeass  antars  stata  j  * 


(2.90) 


Henca.  Equation  (2.84)  is  a  stataaent  of  tha  squality  of  tha  ratas  at 


whioh  the  proosss  enters  and  leaves  stata  j.  Bi 


of  this  tha 


Uniting  or  staady-stata  probabilitias  ara  also  rsfsrrsd  to  as  tha 
aquilibriua  probabilitias. 
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ELEMENTARY  QUEUEING  SYSTEMS  IN  EQUILIBRIUM 


3.1  Introduction 

An  elementary  queueing  systen  ia  one  in  which  both  the 
interarriwel  and  service  tinea  are  exponentially  distributed.  These 
include  a  nnaber  of  oonplex  systens  involving  finite  storage,  multiple 
servers,  finite  customer  populations,  and  the  like.  All  of  these  fall 
into  the  category  of  birth  and  death  procesaea. 


A  birth  and  death  proceaa  is  a  continuous- tine  Markov  process  such 
that:  (1)  the  state  represents  the  number  of  persons  in  the  system, k, 
(2)  new  arrivals  enter  at  an  exponential  rate  Xk,  and  (3)  people  depart 
the  system  at  an  exponential  rate  p^.  That  is  whenever  there  are  k 
persons  in  the  system,  the  time  until  the  next  arrival  is  exponentially 
distributed  with  mean  1/X^  and  is  independent  of  the  time  until  the 
next  departure  which  is  itself  exponentially  distributed  with  seen 
l/pk.  Thus,  a  birth  and  death  process  is  a  continuous-time  Markov 
process  with  states  {0,1,2,..}  for  which  transitions  from  state  k  may 
go  only  to  either  state  k+1  or  state  k-1. 


In  terms  of  the  rates  in  the  lsst  chapter  : 

qk,k+l  “  Xk 


(3.1) 


qk,k-i  ■  **k*  (3*2) 

The  nearest-neighbor  condition  requires  thst  q^j*0  for  Ik-jl  >  1. 


Moreover,  since 


q*j  “  0,  then  q*k  “  -(X^+Hk) 


(3.3) 


The  problea  is  to  determine  the  limiting  or  steady-state 
probabilities.  The  equations  derived  in  the  last  chapter  conld  be  used, 
however,  the  derivation  is  straightforward  and  follows  from  first 
principles.  Therefore,  rather  than  nse  the  results  of  the  last  chapter 
which  tend  to  camouflage  the  basic  approach,  the  equations  will  be 
rederived  for  this  simpler  case. 

The  probability  that  the  system  contains  k  persons  at  time  t+h  can 
be  expressed  as 

m 

Pk(t+h)  -  J  Pi(t)  Pik(h)  .  (3.4) 

i-0 

If  it  is  assumed  that  the  probability  of  two  or  more  state  changes  in 
infinitesimal  time  h  is  negligible  compared  to  single  state  change, 
then  Eqnation(3.4)  becomes 

Pk(t+h)  -  Pk(t)  Pkk(h)  +  Pk_i(t)  Pk_lfk(t) 

♦  Pk+1(t)  Pk+1#k(h)  +  o(h)  (3.5) 

where 

Pkk(h)  *  P[zero  arrivals  and  zero  departures  in  h|  k  in  population], 
Pk_^  k(h)  ■  P[one  arrival  and  zero  departures  in  h|  k-1  in  population], 
Pk+j  k(h)  “  P[zero  arrivals  and  one  departure  in  h|  k+1  in  population], 
o(h)  “  P(multiple  arrivals  and/or  multiple  departures  in  h] . 


In  order  to  justify  the  o(h)  sssumption  snd  to  cslculate  these 
probabilities,  it  is  first  necessary  to  find  the  individual  arrival  and 


departure  probabilities.  The  following  assnaes  that  the  prooets  is  in 
state  k.  The  birth  probabilities  are: 


P[zero  births  in  h]  ■  P[Tk>h]  ■  1  -  PIT^h] 


-  1 


(1-e 


-Xkh 


) 


■  e 


-Xkh 


-  1 


Xkh  + 


(Xkh)2 

2! 


(Xkh)3 

-  +  •  •  • 

3! 


-  l-Xkh+o(h). 


(3.6) 


P[one  birth  in  h]  -  PtT^h] 

(Xkh)3 

- - -  +  •  •  • 

3! 

-  Xkh+o(h).  (3.7) 

P[two  or  aore  births  in  h] 

»  1  -  P[zero  arrivals  in  h]  -  P[one  arrival  in  h] 

-  1  -  [l-Xkh+o(h>]  -  [Xkh+o(h)l 

-  o(h).  (3.8) 


1  - 


-[ 


1  -  Xvh  + 


(xkh>- 

2! 


The  death  ealonlations  are  the  saae  as  births  except  the  parameter 
Xk  is  replaced  by  More  precisely. 

P[zero  deaths  in  h]  *  l-pkh+o(h)  (3.9) 
P(one  death  in  h]  ■  nkh+o(h)  (3.10) 
P[tvo  or  aore  deaths  in  h]  *  o(h)  (3.11) 
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Hie  desired  joint  probabilities  can  now  be  calculated: 

P[zero  births  and  zero  deaths  in  h]  ■  [l-Xkh+o(h)]  [l~nkh+o(h) ] 

-  l-Xkh-|ikh+o(h).  (3.12) 

P[one  birth  and  zero  deaths  in  h]  ■  [Xkh+o(h)]  [l-|ikh+o(h) ] 

-  Xkh+o(h).  (3.13) 

P[zero  births  and  one  death  in  h]  ■  [l-Xkh+o(h)]  [pkh+o(h)] 

-  |ikh+o(h).  (3.14) 

P[two  or  aore  arrivals  and/or  two  or  aore  departures]  -  o(h).  (3.15) 

Substituting  these  results  into  Equatio.  (3.5)  and  adjusting  the 
subscripts  to  account  for  states  fc+1  and  k-1  result  in: 

Pk(t+h)  -  [l-Xkh-pkh+o<h)I  Pk(t)  +  (X^h+oOi)]  Pk_x(t) 

+  [Mk+1^+o(h)]  Pk+1(t)  +  o(h)  .  (3.16) 

Following  the  usual  procedure  of  subtracting  Pk(t)  froa  both  sides, 
dividing  by  h,  and  taking  the  liait  as  h  approaches  zero,  one  obtains 
dPk(t) 

— jp  -  -(Xk+|ik)Pk(t)  +  k^P^Ct)  +  Hk+1Pk+1(t)  (3.17) 

Although  Equation  (3.17)  is  valid  for  all  values  of  k,  it  is  soaetimes 
aore  convenient  to  separate  it  into  two  equations,  one  for  k*0  and  one 
for  k2,l.  This  is  because  soae  of  the  terns  are  zero  when  k*0.  That  is, 
it  is  iapossible  to  have  a  negative  nuaber  of  custoaers,  and  when  the 
nuaber  of  custoaers  is  zero  the  death  rate  is  zero.  More  precisely. 


dtyo 

dt 


-X0P0(t>  +  ° 


for  k*»0 


(3.18a) 


dPk(t) 

-  -(Xk+|ik)Pk(t)  +  X^P^t)  +  l»k+lPk+l(t)  for  k^l  (3.18b) 

Equations  (3.18a)  and  (3.18b)  are  idantioal  to  tbe  equations  that  would 
haw#  been  obtained  by  substituting  the  proper  values  of  qkj  into 
Equation  (2.67). 

The  solution  to  this  set  of  differential  equations  depends  on  the 
rates  Xk  and  pk.  Unfortunately,  no  natter  how  simple  Xk  and  are,  it 
is  nearly  inpoaaible  to  obtain  the  transient  solution.  Fortunately, 
one  is  usually  only  interested  in  the  steady-state  solution,  and  it  is 
easy  to  obtain.  The  linits  as  t  approaches  infinity  of  Equations 
(3.18a)  and  (3.18b)  are 


0  -  Vo  +  Vl 

for  k»0 

(3.19a) 

o  -  -(xk+nk)Pk  +  xk_1Pk_1  +  nk+1Pk+1 

for  ky.. 

(3.19b) 

Vo  “  Vi 

for  k“0 

(3.20a) 

(Xk+|1k>Pk  “  Xk-lPk-l  +  Pk+1PE+1 

for  kjjl  . 

(3.20b) 

The  left  hand  sides  of  equations  (3.20a)  and  (3.20b)  are  simply  the 
rate  of  flow  out  of  state  k,  while  the  right  hand  sides  are  the  rate  of 
flow  into  state  k.  In  problems  of  this  sort  it  is  often  helpful  to 
sketch  a  diagram  showing  the  average  rate  of  flow  from  one  state  to 
another.  Such  a  state-transition-rate  diagram  is  shown  in  Figure  3.1. 


Figure  3.1  State-Transition-Rate  Diagram  of  the  Birth  end  Death  Process 

By  equating  the  flow  rate  ont  of  a  state  to  the  flow  rate  into  the 
saae  state,  the  following  equations  arise: 

state  rate  out  -  rate  in 


k.k^l 


Vo  "  Vl 

<V>1>P1  “  *0P0+|12P2 

a2^2)P2  “  X1P1+>*3P3 
*  WP3  “  X2P2+|I4P4 
<kk+l»k)pk  “  Xk-lPk-l+|ik+lPk+l 


(3.21) 


Solving  these  equations  in  tents  of  PQ  yields: 


HW3 


VlV***k-2*k-l 

^^•••“k-l^k 


(3.22) 


Pg  can  be  determined  fro*  the  conservation  of  probabilities  equation. 
That  is 


Clearly  for  the  Uniting  probabilities  to  exist  it  is  necessary 

that  „ 

T  • ■ ' ^k-2^k-l  <  •  .  (3.24) 

AWj-^k-'ruk 

This  condition  also  nay  be  shown  to  be  sufficient  [KLEI75]. 

3.3  Birth  and  Death  Processes  and  Elenentarv  Oneneina  Systems 

By  properly  selecting  the  birth  and  death  rates,  a  number  of 
rather  complex  queueing  systems  can  be  modeled.  The  birth  process 
corresponds  to  the  arrival  process  and  death  process  to  the  service 
process.  If  the  system  is  in  stste  k,  the  arrivsl  rste  is  Xk  and  the 
service  rate  The  birth  and  desth  model  does  not  explicitly  allow 
for  specifying  a  rule  for  deciding  which  among  several  customers  is  to 
be  served  next,  nor  is  one  required.  This  is  because  the  stste  of  the 
process  is  invariant  to  the  order  in  which  customers  are  served.  The 
reason  for  this  is  that  all  customers  are  assumed  to  be  statistically 


identical  and  the  service  process  has  the  memoryless  property.  Perhaps 
the  most  commonly  used  rule  and  the  one  whose  operation  is  most  easily 


visualized,  is  the  f irst-coae-f irst-serve  rule.  However  the  service 
discipline  can  be  last-coae-first-serve,  or  service  in  randoa  order.  An 
arriving  cnstoaer  can  even  preeapt  the  service  of  a  cnstoaer  without 
changing  the  dynaaics.  The  key  in  all  these  cases  is  that  a  server  is 
never  idle  when  custoaers  are  waiting  in  the  queue,  and  that  the 
probability  of  a  cnstoaer  departing  the  service  center  in  the  next 
increaental  interval  is  pkh  independent  of  the  aaount  of  service 
previously  received.  Of  course,  it  is  necessary  that  the  service 
discipline  be  work  conservative.  However,  this  does  not  iaply  that  if  a 
cnstoaer  is  interrupted  the  aaount  of  service  he  received  aust  be 
reaeabered.  The  PDF  of  the  service  tiae  is  aeaoryless! 

3.4  M/M/1 

The  siaplest  and  one  of  the  aost  celebrated  queueing  systeas  is 
one  in  which  the  birth  and  death  rates  are  constant  regardless  of  the 
state  of  the  systea.  More  precisely, 

Xk  -  X  for  k  -  0,1,2,...  (3.25) 

pk  ■  H  for  k  “  1,2,3,...  .  (3.24) 

Recall  that  when  the  arrival  rate  is  constant  (that  is  it  does  not 
depend  upon  the  state  of  the  process)  the  arrival  process  is  Poisson. 

The  state-transition-rate  diagraa  of  this  systea  is  depicted  in 


Figure  3.2 


Figure  3.2  State-Traasitioa-Bate  Diagraa  for  M/M/1  Systea. 


By  eqaatiag  the  flow  rate  oat  of  a  state  to  the  flow  rate  iato  the 
saae  state,  the  folloviag  eqnatioas  arise  : 

state  rate  oat  »  rate  ia 

o  xp0  -  ^ 

1  (X+ji)?!  -  XP0+|iP2 

2  (X+|i)P2  -  XPj+iiPj 

3  (X+|»)P3  -  XP2+(iP4 

X.k21  (X+|»)Pk  -  XPk_1+nPk+1  .  (3.27) 

SolTiag  these  eqaatioas  ia  tens  of  Pq  yields  : 

P2  -  (X/ p)  P„ 


P2  -  (X/ |i)Z  PQ 


P3  -  (X/p)3  Pq 


Pk  -  <X/p)*  p0. 


(3.28) 


Agaia,  Pq  oaa  be  foaad  froa  the  eoaservatioa  of  probabilities  eqaatioa. 
More  precisely. 


p0  +  2  u/p>k  po  ■ 1 


p0  5  <*/p>k  - 1 

k-0 


p°  1= 


(X/p> 


P0  -  l-(X/p), 


(3.29) 


The  utilization  of  the  service  oenter  is 

p  -  1-Pn  -  X/p. 


(3.30) 


The  quantity  X/p  appears  frequently  in  the  performance  parameters,  and 
therefore  it  is  customary  to  give  them  in  terms  of  the  utilization,  p. 
The  steady-state  probability  that  the  system  contains  k  customers 


Pt  -  pk(l-p). 


(3.31) 


The  mean  number  of  customers  in  the  system  and  its  varisnce  can  be 
calculated  by  the  probability  generating  function  (which  is  very 
similar  to  the  z-transform)  [ILEI75]  [K0BA81].  By  definition  the 
probability  generating  function  is. 


P(z)  -  J  Pk  zk 
kH) 


(3.32) 


The  mean  or  first  moment  is  is  equal  to  derivative  of  P(z)  evaluated  at 
z  equal  to  one.  More  precisely. 


di  ih  ‘ku  -it  [p‘  p‘ 


-  E[N]  -  L  . 


(3.33) 


The  second  derivative  of  P(z)  evalneted  at  z  equal  to  one  is 


J  k  (k-1)  P*  -  E[N2]  -  E[K]  .  (3.34) 

k-0 


Hence,  the  second  aoaent  and  varianoe  are  respeotfully: 

d2P(z)j 


EIN2] 


+  E[H]  , 


dz^  I z-1 


Var[N]  -  EEN^-fElN])2. 


(3.35) 


(3.36) 


Returning  to  the  problea  at  hand  and  anbatitnting  Pk-pk(l-p) 
results  in 


P(z)  -  |  pk(l-p)  zk  -  (1-p)  J  <P*>k 
k-0  k-0 


and 


and 


1-P 
"  1-P* 


L  ■ 


Var[N]  -  - -  * 

(1-P)2 


(3.37) 


(3.38) 


(3.39) 


The  average  response  tine  can  be  calculated  by  Little's  law.  More 


precisely, 

L  m  L  _  p  _  1  . 

"  T  "  X  "  X(l-p)  "  p(l-p) 


(3.40) 
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Little'*  lav  can  also  be  used  to  oalenlate  the  sets  nuaber  of 


custoaers  in  the  queue,  L^.  However,  it  is  fii 


try  to  calculate 


the  aean  waiting  tiae,  W^.  Since  the  aean  of  a  sun  is  equal  to  the  sua 


of  the  aeans  (irrespective  of  dependencies  involved),  it  follows  that 


H  -  f q  +  E[S]» 


(3.41) 


f  -  R  -  E[S]  -  — - - -  -  — - - 

4  p(l-p)  u  p(l-p) 


(3.42) 


Little's  law  can  now  be  applied  to  deteraine  L^: 


X  p  px 

L  -XT  -  -  — - —  ■ 

4  4  *  (1-p)  1-p 


(3.43) 


Another  interesting  quantity  to  calculate  is  the  probability  of 


finding  at  least  i  custoaers  in  the  systea: 


P[k2i]  -  }  Pk  -  ^  PkU“P>  *  (1-P)  r  j  pk  -  5  Pk  1  -  pi  <3-44> 
k-i  k=i  Lk=0  k»0 


where  the  last  expression  follows  upon  application  of  the  algebraic 


identity 


\  pl  *  d-pi)/(i-p), 

k-0 


(3.45) 


Figure  3.3  coapares  the  uoraalised  aean  response  tiae  (1/p-l)  of 


the  M/M/l  systea  to  that  of  the  D/D/1  systea.  For  both  systeas  the  end¬ 


point  values  are  the  saa*.  More  precisely,  when  p-0,  the  uoraalised 


aean  respona*  tin*  is  one,  and  when  p-1,  the  response  tine  is  infinite. 


However,  for  values  of  p  near  one  there  is  an  extreae  difference.  For 


exaaple,  when  p- 0.9  the  aean  response  tine  of  the  M/M/1  systea  it  ten 
tiaee  that  of  the  D/D/1  systea.  Clearly*  the  D/D/1  curve  ia  the  optiaal 
one*  and  a  large  penalty  ia  paid  for  operating  the  M/M/1  ayatea  near 
ita  aaziana  oapaeity.  The  reaaon  for  thia  ia  that  there  are  no 
atatiatioal  flnotnationa  in  the  D/D/1  ayatea*  whereas  both  the 
interarrival  and  service  tiaee  are  randoa  variables  in  the  M/M/1 
ayatea.  Any  rednetion  in  the  variation  of  either  of  theae  reduces  the 
response  tiae*  while  any  increase  reanlta  in  an  increased  response 
tiae.  In  faot  it  will  be  shown  later  that  the  aean  waiting  tiae  (a 
quantity  closely  related  to  the  response  tiae)  of  the  M/D/1  ayatea  ia 
exactly  one-half  of  that  for  the  M/M/1  ayatea. 

Figure  3.4  coaparea  the  aean  nuaber  of  custoaera  in  the  M/M/1 
ayatea  to  that  of  the  D/D/1  ayatea.  Note  that  curve  for  the  D/D/1  is  a 
straight  line  over  the  region  p<l  (L-p),  and  when  p-1  the  nuaber  of 
custoaera  is  infinite.  Again  the  differences  in  the  curves  are  due  to 
the  statistical  fluctuations  in  M/M/1  ayatea. 


3.5  M/M/a  -  Finite  Nuaber  of  Servers 

Nov  consider  the  case  when  the  nuaber  of  servers  is  aore  than  one 
and  finite.  Assuae  there  are  a  servers.  The  birth  and  deaths  rates  are: 

lk  -  X  k  -  0*1*2,...  (3.46) 

Uk  “  ain[kp,B|t]  .  (3.47) 


The  state-transition-rate  diagraa  is  depioted  in  Figure  3.S. 


Figure  3.5.  State-Transition-Rate  Diagram  for  M/M/m  System 


The  steady-state  equations  are  : 


lift  t  a 

0 

1 

2 

3 

m-1 


m+1 

m+2 


rate  out  ~  rate  in 
**0  "  »*1 

(X+jOPj  -  XPQ  +  2jlP2 

(X+2ji)P2  -  XPj  +  3|iPj 

(X+3|»)P3  -  XP2  +  4|iP4 

[X+(a-l)p]par]i  -  XP^j  +  miiP^ 

(X+muJP^  -  XP^  +  miiP^j 
(X+mjiJP^  -  XPB  +  ujiP^-2 
(X+mjOP.+j  "  +  ■^P«+3  • 


Solving  the  first  a  equations  in  terms  of  Pq  yields: 

P2  -  (X/n)  PQ 

P2  -  (1/2)  (X/n)2  P0 

P3  -  (1/6)  (X/n)3  P0  , 

and 

Pk  -  (1/kl )  (X/|i)k  P0  for  him  . 


Similarly,  solving  the  equations  for  states  m,a+l,  and  a+2  yields 


P«+l  "  U/P>  *  P0 

P«+2  “  tt/P>“+2  P0 

P«+3  "  (X/|i)“+3  P0  , 

Pk  -  (l/ala*-")  (X/p)k  PQ  for  k^n 


Collecting  the  results  together 


C  (l/«!»k_>)  <X/p)k  P0  for  k^a 
k  \(l/k!)  (X/ji)k  P0  for  k£a  , 


or  equivalently 


p 

k!  P° 


■!  P0 


for  k£a  , 


for  k2.a  , 


where 


P  ■  — 

■P 


Solving  for  P«  in  the  nsnsl  way  results  in: 


k-l  k-a 


n  r  ^  («p)k  .  («p)*  1  -1 

0  “  L  ^  k!  Bf  (1-p)  ] 


Similarly  the  aean  nnaber  of  enstoaers  in  the  tyatea  it: 

L-  JkPk 
k-l 


Vt  <“■>*  p  *  5  *  .»  ^ 
i  in  po  *  2  —  po 

k-l  k-a 


_  .  ^  <■»>*  .  <-P>*  S  k 

”o  2  Tiirrr  *  p»  —  2 <«♦»  p 

k-l  k-0 

*"2  . 

-  P  fmo)  \  <-»>k  +  p  <«p>"  r  ■  +  p  1 
°  in  11  °  ■'  *•  (1-p>  <1— p)2  1 


ap  + 


k-0 
P  ("P)" 


,  0  * 
l-<o2 


(3.54) 


a!  (1-pV 

Figure  3.6  it  •  plot  of  the  aean  nnaber  of  onttoaert  vertu  the 
arrival  rate  for  a-1,  a-2,  and  a-3  (1/p^l).  Obterve  that  the  thape  of 
all  three  curvea  are  aiailar. 


Again  Little’a  Lav  can  be  naed  to  deteraine  the  aean  retponte 

tint: 


R  - 


L 

X 


1 

M 


[ 


1  + 


p  (ap)*-1 
■f  (1-p)2 


] 


(3.55) 


Figure  3.7  it  a  plot  of  the  noraalized  aean  retponte  tine  verso 
the  arrival  rate  for  a-1,  a-2,  and  a-3.  Again  obaerve  that  the  thape  of 
the  curvet  are  very  aiailar. 
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Arrival  Rato 


Figure  3.7  Mean  Re  spouse  Tine  Versus 
for  the  M/M/a  Systea. 


wwv 


Now  consider  the  esse  when  the  nuaber  of  servers  is  infinite.  Thst 


is.  whenever  s  customer  enters  the  queue,  he  innedistely  stsrts  to 


receive  service.  This  system  is  eqnivslent  to  one  in  which  the  nuaber 


of  servers  alwsys  equals  the  nuaber  of  customers  in  the  system.  In 


terns  of  the  birth  and  death  nodal  the  ratea  are  : 


Xk  «  X  k  *  0,1.2,... 


(3.56) 


Pk  ”  kp  k  ■  1,2,3,...  . 


(3.57) 


The  state-transition-rate  diagram  is  depicted  in  Figure  3.8. 


2  )  •  •  •  k 


k/i  (k+1 )  M 


Figure  3.8  State-Transition-Rate  Diagram  for  M/ M/*»  System. 


The  resulting  equilibrium  equations  are: 


•Ml 


*po  -  1*1 

(X+I»)P1  -  XP0+2^P2 


k.k^l 


(X+2ji)P2  -  XP1+3\iP3 
(X+3p)P3  -  XP2+4(iP^ 

(X+kji)Pk  -  XPk_2+(k+l)|iPk+1 


(3.58) 


,j/v 


,»  /  '•’•y  %  «"*  •'*  «\k  i.'*  -N 


Solving  these  equation  in  tens  of  Pq  yields: 

?1  -  a/jo  p0 

P2  -  (1/2)  (X/p)2  P0 
P3  -  (1/6)  (X/p)3  PQ 
Pk  -  (1/k! )  (X/|i)k  P0  . 


Solving  for  Pn  yields 


Hence, 


P0  [l  +  J  (l/kl)  (X/p)k] 
k-1 


p0  [  }  (1/k!)  <X/^)k]  -  1 
k-0 


P0  eX/»*  -  1 


P  at  _~X/  P 

ro  * 


Pk  -  (1/k!)  (X/p)k  •~X/K 


The  aesn  nnaber  of  customers  in  the  service  center  is 

m 

L-SkPt 

k-0 


j  k  (l/kl)  (X/p)k  •~X/* 

k-0 


e“x^  (X/p)  \  (1/k!)  (X/|i)k 
k-0 

X/p  . 


The  throughput  of  the  system  is  obviously  X.  The  aesu  respoase 


tine  can  easily  be  determined  by  Little's  lav: 


»  L  1 

R  -  —  •  — 

X  I* 


(3.63) 


This  is  obviously  oorreot  since  each  arriving  customer  is  immediately 
granted  a  server  and  the  average  service  time  is  1/ji. 


3.7  M/M/l/K  -  Finite  Storage 

Nov  consider  the  problem  in  vhioh  the  arrival  rate  and  departure 
rates  are  constant,  but  there  is  a  maximum  number  of  customers  that  the 
system  can  contain.  Assume  that  at  most  the  system  can  hold  L  customers 
and  that  any  further  arriving  customers  vill  refuse  to  enter  the  queue 
and  vill  depart  immediately  vithout  receiving  service.  This  system  is 


equivalent  to  a  birth  and  death  process  vith  the  follovii 


X  k<K 


0  k^I 


Hk  -  H  k  -  1.2, ...I  . 


(3.64) 


(3.65) 


the  system  fills  up,  the  input  is  effectively  turned 


Thus, 


off.  The  state-transition-rate  diagram  is  depicted  in  Figure  3.9. 


•  ••  K- 1 


Figure  3.9  State-Transition-Rste  Diagram  for  M/M/l/K  system. 
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■iVin 


Obviously  ths  equations  srs  tbs  sane  ss  for  the  M/M/1  osse  except 


that  ”0  whin  k>L.  Hence, 

r U/p)k  P0  kil 

k  \  0  k>K  .  (3.66) 

Solving  for  Pq  is  sonewhat  more  difficult,  but  again  tke  conaervation 
of  probabilities  equation  is  used. 

P0  ♦  \  U/p>k  P0  -  1 

k”l 


P 


0 


i-q/n)  . 

l-(A/p)I+1 


(3.67) 


Hence, 


[l-(X/p)](X/n)k  . 
l-(X/p)I+1 


(3.68) 


Since  there  is  only  a  single  server  the  utilization  is 

p  -  1  -  P0  .  (3.69) 

and  naan  throughput  ia 

T^pp.  (3.70) 

Another  quantity  of  interest  in  this  systea  is  the  probability 
that  an  arriving  customer  finds  the  systen  full,  and  therefore  leaves 


without  receiving  service.  This  probability  it 


[l-CX/iiJHX/ii)' 


l-(X/p) 


This  aodel  ia  often  referred  to  at  the  aaohine  repair  aodel. 


Consider  a  job  shop  which  consists  of  N  aaehii 


riceaan. 


As  suae  that  the  aaouat  of  tiae  each  aaohine  runs  before  breaking  down 


is  exponentially  distributed  with  aean  1/X,  and  assuae  that  the  aaonnt 


of  tiae  for  the  servioeaan  to  repair  a  aaohine  is  exponentially 


distributed  with  aean  1/p.  The  birth  and  death  rates  for  such  a  systea 


(N-k)X  k£M 


0  k2M 


(3.72) 


»ik  -  |i  k  -  1,2,3,...  . 


(3.73) 


Since  there  is  only  one  servioeaan  the  service  rate  is  p. 


regardless  of  the  nnaber  of  aaohines  down.  On  the  other  hand,  if  k 


nachines  are  not  in  use,  then  since  the  M-k  aaohines  in  nse  each  fail 


at  a  rate  X,  it  follows  that  Xk"(M-k)X.  In  the  sense  that  a  failing 


aaohine  is  regarded  as  an  arrival  and  a  repaired  aachine  as  a 


departure,  the  systea  represents  a  queueing  systea  with  s  finite 


population.  The  state-transition-rate  diagraa  is  depicted  in  Figure 


3.10. 


(M-1)X  (M-2)X  3X 


Figure  3.10  State-Transition-Rate  Diegraa  for  M/N/1//M  Systea. 
The  resulting  steady-state  equations  are: 


Hite 


k.kil 


MXP0  -  liPx 

[(M-Dk+ulPj  -  HXP0+|iP2 
[(*-2)X+|i]P2  -  (M-l)XJ>1+|iP3 
[(M“3)k+|i]Pj  -  (M-2)XP2+|iP4 
[(M-k)X+n]Pk  -  (M+l-k)XJ«k-1+|iPk+1 


Solving  these  equation  in  tens  of  Pq  yields 

P2  -  M  (X/n)  P0 


P2  -  M(M-l)  (X/|i)Z  P0 
P3  -  M(M-l)  (M-2)  (X/|i)3  PQ 

r[KI/(M-k)!]  (X/|i)k  P0 

P‘-l  0 


Solving  for  P0  is  the  usual  way  results  in: 


P0  -  [  [M!  /  (M-k)  I  1  (X/,)k]  1  . 


(3.74) 


(3.75) 


(3.76) 


*  s"^  V 

>  w’.  « /«  ••  .  .  V/ W  '/V  ‘V«.  <i*  .  '.'.".ft1 


Sinee  there  ie  only  a  single  server  the  ntilizstion  is 

P  "  1  “  Pfl 


1  -  [  5  [MI/(M-k)ll  U/h)1]"1 

k=0 

[  j|  [Ml / (M-k) !  ]  (X/|i)k]  -  1 
k-0 

■  -  -  i 

)  [Ml /  (M-k)  I  ]  <X/|»)k 
k-0 

5  [1/ (M-k)  I J  U/|Ok 
k-1 

I  ,  .  .  - - -  ,  .  * 

j!  [l/(M-k)  I  ]  <X/n>k 


Finally  letting  i-a-k  and  ohanging  variables  results  in: 

K-1 

5  (l/il)  <X/|a) 1 
i-1 


(1/i!)  (X/ |t) ' 


Similarly,  the  nean  nuaber  of  oustoaers  in  the  systea  is: 


as 


,**_*",.  <_  r,  a"  r  r.  wT  r,  r  f  r,  .%  •  •-  <  *• 


k  [MI/(M-k)|]  (X/p)J 


[M! / (M-k) ! ]  (X/p)1 


u-O-L  - 
x 


(3.79) 


The  seen  throughput  is 


T  -  p  p  . 


(3.80) 


Again  using  Little's  Lav  to  find  the  response  tine  yields: 


_  L  _  M-(X/p)p  M  1  . 
T  P  |i  P  P  P 


(3.81) 


Several  other  queueing  systens  can  be  nodeled  by  judicious 
assignnents  of  the  rates  Xk  and  p^.  For  exanple,  the  following  systens 
are  solved  in  Kleinroek  :  M/M/n/n  -  M  server  loss  systen,  - 
finite  oustoner  population  -  infinite  nunber  of  servers,  M/M/n/K/M  - 
finite  population  -  n  servers  -  finite  storage,  and  other  cases 
including  disoouraged  arrivals  [KLEI73]. 


CHAPTER  4 


QUEUEING  MODELS  WITH  GENERAL  SERVICE  OR  ARRIVAL  PATTERNS 


4.1  The  M/O/l  Queue ini  System 

The  M/G/l  model  represents  the  contention  for  s  single  server 
under  the  sssnaption  thst  the  arrival  process  is  Poisson.  Thus,  this 
model  is  more  generel  then  the  M/M/1  in  that  there  ere  no  restrictions 
on  the  distribution  of  the  service  times.  The  difficulty  in  analyzing 
this  model  stems  from  the  fact  that  the  distribution  of  the  service 
times  is  not  memoryless.  Information  about  vhen  the  service  started 
assists  in  predicting  vhen  the  service  vill  be  completed.  Hence,  the 
number  of  customers  presently  in  the  system  is  not  enough  information 
to  predict  the  number  of  customers  in  the  future.  Therefore,  the 
process  can  no  longer  be  represented  as  a  continuous-time,  Markov  chain 
with  the  number  of  customers  in  the  system  serving  as  the  stste  space. 

However,  if  the  system  is  observed  only  at  departure  instants  the 
past  history  plays  no  roll  in  predicting  the  future.  This  is  because 
service  is  just  starting,  and  prior  information  cannot  aid  in 
predicting  vhen  it  vill  be  completed.  The  past  history  also  cannot  help 
with  arrivals  since  the  interarrival  times  have  a  negative  exponential 
distribution  and  are  therefore  memoryless.  Hence,  if  the  system  is 
observed  only  at  departure  instants  (immediately  after  a  departure)  the 
system  appears  to  be  a  Markov  chain.  Such  a  process  is  referred  to  as 
semi-Markov  process  with  an  embedded  discrete-time  Markov  chain.  Thst 
is,  the  behavior  of  the  system  at  the  departure  instants  can  be 


described  by  s  Markov  chain.  Fortunately,  the  solution  at  these 
eaibedded  points  happens  also  to  provide  the  solution  for  all  points  in 
tiae  [C0HE69]  [CINL75], 


Recall  froa  Chapter  3  that  the  Halting  probabilities  of  a 
discrete-tine  Markov  chain  can  be  found  froa 

V  -  V[P]  (4.1) 
where  V  “  [Pq.Pj.Pj,...]  and  [P]  is  the  one-step  transition  aatriz.  The 
elenents  of  [P]  are  the  one-step  transition  probabilities: 

Pij  "  pIXn+l“jl V11  *  (4*2) 

That  is,  Pjj  is  the  conditional  probability  that  the  next  state  is  j, 
given  that  the  current  state  ia  i.  Since  the  eabedded  process  is 
obtained  froa  the  continuous  process  by  observing  the  systen 
iaaediately  after  a  departure,  it  follows  that 


Xn  +  Vl  {or 


for  Xa-0, 


(4.3) 


where  XQ  is  the  nuaber  of  custoaers  in  the  systen  at  the  nth  departure 
point  and  is  the  nuaber  of  custoaers  who  arrive  during  the  service 


tiae  of  the  (n+l)st  custoaer.  Thus,  j<i-l  is  an  iapossible  situation 


whereas  j2,i~l  possible  for  all  values  since  any  nuaber  of  arrivals 


can  ocour  during  one  service  tiae.  It  follows  that  the  fora  of  the  one- 


step  transition  aatriz  is: 


where  »k  -  P[k  arrivala  during  one  aerviee  tine].  For  exaaple  i_1  it 
the  probability  that  zero  arriyala  ooonr  during  one  aerviee  period,  and 
Pj  j  it  the  probability  that  one  arrival  ocenra  during  the  aerviee 
period  (the  one  arrival  offeeta  the  one  departure).  Alto,  note  that  the 
firat  two  rowa  of  thia  aatriz  are  identical.  Thia  ia  becauae  if  a 
departing  cuatoaer  leavea  an  eapty  ayatea,  the  atate  reaaina  zero  until 
an  arrival  oocura.  The  graphical  fora  of  the  proceaa  ia  depicted  in 
Figure  4.1.  The  labela  on  the  area  are  probabilitiea. 


Figure  4.1  State-Tranaition-Probability  Diagraa  for  the  M/6/1  Syatea 


Now,  since  the  arrival  process  is  Poisson  with  rste  X,  the 


conditional  probability  of  k  arrivals,  given  that  the  service  time  is 
x,  is 

P[k  arrivals  |  the  service  tiaie  -  t]  ■  — ' ^  lh&£.  •  (4.5) 

Thus,  the  unconditional  probability  of  k  arrivals  is, 

ak  -  f  — dB(t)  ,  (4.6a) 

ox 

»k  ■  r  . . *<*>  ** » 

Jq  kI 

where  B(t)  is  the  probability  distribution  function  (PDF)  of  the 
service  tiaes,  and  b(t)  the  probability  density  (pdf)  of  the  service 

tiaes. 

Returning  to  the  problea  of  finding  the  liaiting  probabilities,  it 
follows  that  the  coaponent  fora  of  Equation  (4.1)  for  the  M/G/l  case  is 

k+1 

pk  "  p0  *k  +  ^  pi  *k+l-i  •  (4*7) 

i-1 

This  equation  can  be  solved  by  the  aethod  of  probability 
generating  functions.  By  definition  the  probability  generating  function 
is 

e» 

F(i)  -  J  fk  *k  •  (4.8) 

k-0 

The  procedure  is  to  use  the  probability  generating  function  to 
transfora  Equation  (4.02)  into  a  function  of  z,  and  to  then  solve  for 
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V  >  *J»  •  a  V  • 
OTa-***  a  ' *  a  ' 

& 


’Z-'  Z'  -\Vv\ ■  V* 

^ »/ y oV-VA  a  -  '->  v  v 


P(z).  Once  P(z)  has  been  deterained,  the  Uniting  probabilities  can  be 
found  froa  the  series  expansion  of  P(z).  More  precisely,  the 
coefficient  of  the  z*  tern  is  P^.  Multiplying  both  sides  of  Equation 
(4.7)  by  zk  and  sunning  froa  k-0  to  k-“,  results  in 


•  k+1 


}  Pk  *k  -  5  Po  »k  *k  +  }  }  Pi  «k+i-i  *k  •  (*.»> 

k-0  k>0  k-o  i-1 


tfi, 


Interchanging  the  order  of  the  double  suaaation  and  sinplifying  results 


P(z)  -  P0  a(z)  +  ^  ^  Pi  a^.i  zk 


i-1  k-i-1 


Po  »(*>  +  5  5  Pi  *J 

i*l  j  *0 


-  Pg  a(z)  +  z-1  ^  Pj  z1  ^  aj  z^ 

i-1  j-0 

-  P0  a(z)  +  z~ 1  [P(z)-P0]  a(z)  . 
Solving  this  last  equation  for  P(z),  results  in 


(4.10) 


P0  a(z)  [z-1] 

P(*)  -  -2 - pr - 

z-a(z) 


(4.11) 


Froa  the  definition  of  the  probability  generating  funotion,  a(z)  is 


~kT  (Xr)k 


.(*)  -  5  r  r  s2ll 
Jo  1  Jo  kl 


b(r)  dt 


vr/ v  V;  jv v*  v  V  V  v  j  .  ■ .  *  ,  *s  .v«  •  A  . 


(4.12) 


Interchanging  the  order  of  the  summation  and  the  integration,  results 
in: 


a(z) 


b(x)  d(x) 


f  *-<*•->•*>*  b(t)  d(x) 
Jn 


(4.13) 


The  last  equation  is  the  saae  as  the  Laplace  transform  of  b(x)  except 
that  the  parameter  s  has  been  replaced  by  X-Xx.  Let  b*(s)  denote  the 
Laplace  transform  of  b(x),  then  a(z)  ■  b*(X-Xz).  Substituting  the 
result  into  Equation  (4.11)  results  ic 


P0  b  (X-Xz)  [z-1] 

P(z)  .  -  •  (4.14) 

z  -  b*(X-Xz) 


Pq  can  be  determine  from  this  last  equation  by  taking  the  limit  of  both 
sides  as  z  approaches  one.  The  limit  of  P(z)  as  z  approaches  one  is  : 


(4.15) 


In  addition  the  limit  of  b*(X-Xx)  as  s  approaches  one  is  b*(0)  -  1. 
That  is,  b(x)  is  a  density  function,  and 


r. 


b(x)  dx 


(4.16) 


It  follows  that  the  linit  as  s  approaches  one  of  Equation  (4.14)  is 
indeterminate  and  l'Hopital's  rule  must  be  used.  The  derivative  of 
b*(X-Xz)  evaluated  at  x*l  is 
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-  XE[S]  ,  (4.17) 

where  ECS]  it  the  average  or  expected  value  of  the  aervice  time.  Using 
this  and  applying  l'Hopital'a  rule  results  in 

PQ  -  1  -  XE[S]  .  (4.18) 

The  utilization  is  therefore 

p  -  1  -  P0  -  XE[S]  .  (4.19) 

Substituting  this  into  Equation  (4.11)  yields  the  Pollaezek-Khinchin 
(P-C)  transfora  equation 

(1-XEES])  b*(X-Xz)  (z-1) 

P(z)  -  - - -  ,  (4.20a) 

1  -  b  (X-Xz) 


or  equivalently 

(1-p)  b*(X-Xz)  (z-1) 

P(z)  -  - - - -  •  (4.20b) 

1  -  b  (X-Xz) 


As  derived  in  Chapter  3  the  mean  value  of  P^  equals  the  derivative 


of  P(z)  evaluated  at  z-1.  After  using  l'Hopital's  rule  twice  the  result 


I'-O  »>,.  »*  ■  H  , jt,,  t'i  »  *f.  S».  .1  .>  .1  ><_*,+  ' 


it  tf  M  .#  u* 


X2E[S2]  ,  , 

L  -  iu^isTT  * ‘E,sl  • 


(4.21) 


The  appearance  of  the  second  nonent  in  this  equation  cones  froa  the 


fact  that: 


-Art*]. 


(4.22) 


The  aean  response  tine  can  be  calcnlated  froa  Little's  lav.  More 


precisely. 


L  .  L  _  XB[S*1 
T  X  2<1-1E[S]) 


The  aean  waiting  tiae  is  obviously  ■  R  -  E[S].  Hence, 


(4.23) 


»  XElS*] 
r«l  “  2(1-XE[S]  ) 


(4.24) 


The  aean  nuaber  of  custoaers  in  the  queue  can  be  deterained  froa  Wq. 


That  is 


Lq  m  ^q  “  ^q 

X2E[S2] 

"  2(1-XE[S] ) 


(4.25) 


As  an  ezaaple  consider  the  M/M/1  systea.  The  density  function  of 


for  the  service  tines  is 


b(r)  -  pe-^  , 


(4.26) 


.e.  x  M 

b  (s)  -  - 

s+p 


(4.27) 


Ms-:*# 


*  S  V\  \  •/  \ 


pVbVs  ircwraei 


The  approach  taken  here  of  siaply  stating  that  the  eolation  of 
both  processes  is  the  sane,  is  that  taken  by  noat  texts  on  queueing 
theory  [KLEI75]  [ALLE78]  [R0SS80]  [I0BA81]  [HAYE84].  The  reader  is 
advised  to  beware  of  short  sinple  proofs  claiming  to  prove  that  both 
processes  have  the  sasie  solution.  In  particular  the  proofs  in  Gross  and 
Cooper  are  incomplete  [GR0S74]  [COOP84].  Both  prove  siaply  the 
probability  that  an  arriving  eustoaer  finds  k  cnatoaers  in  the  system 
is  equal  to  the  probability  that  a  departing  onstoaers  leave  k  in  the 
systea.  As  pointed  out  in  Ross  and  Kle inrock  this  is  true,  not  only  for 


the  M/G/l  systea,  bnt  also  for  the  M/X/l,  G/M/l  and  G/G/l  systeas 


of  the  serviee  tine.  That  it,  for  a  fixed  lean  value,  aa  the  second 


■  oaent  or  var'ianee  increases  so  does  L,  Lq,  M,  and  f^.  Also  note  that 
and  are  exactly  one-half  of  that  for  the  M/M/l  systea.  This 
results  froa  the  faot  that  the  second  aoaent  of  service  tiae  for  the 
M/M/l  is  2/p*,  which  is  exactly  twice  that  of  the  M/D/1  systea. 

Although  they  will  not  be  derived  here,  the  probability  generating 
function,  custoaer  distribution  and  variance  for  the  M/D/1  systea  are 
[LAVE83]: 


P(x) 


(1-p)  (1-a)  # 

1  -  ,e*(l“*> 


(4.38) 


Pk  ”  d-p)  \  (-l)k_j 
j-o 


(k-j)l 

4 


V«r[N]  -  p  ♦  *  P 


6(l-p)  4 ( 1-p ) 


(4.39) 


(4.40) 


Notice  that  these  equations  (and  their  derivations)  are  auch  more 
coaplicated  than  the  corresponding  expressions  for  the  M/M/l  systea. 
That  is,  the  fact  that  service  tiae  is  constant  drastically  coaplicates 
the  analysis  rather  than  siaplifying  it! 


4.1.3  M/Q/l  Nonpreeantlve  Priority 

While  this  aight  not  seen  to  be  the  appropriate  place  to  discuss 
the  priority  service  discipline,  all  the  results  here  apply  also  to  the 
M/M/l  nonpreeaptive  priority  queue,  end  furtheraore  these  are  the  only 


known  results.  A  priority  queueing  systea  is  one  in  which  customer*  ere 
grouped  into  clssses  end  then  given  priority  sccording  to  their  clsss. 
Although  there  sre  several  service  disciplines  based  on  priority,  only 
the  nonpreeaptive  discipline  will  be  discussed  here.  Vhile  it  would  be 
nice  to  have  an  explicit  expression  for  the  probability  distribution  of 
custoaers  or  a  transform  expression,  no  one  has  derived  such  an 
expression.  Thus,  the  following  analysis  is  concerned  with  deteraining 
the  aean  values  of  the  perforaance  parameters. 

It  is  assumed  that  the  custoaers  are  divided  into  n  classes 
nuabered  1  to  n,  and  that  the  lover  the  priority  nuaber  the  higher  the 
priority.  That  is,  custoaers  in  priority  class  i  are  given  preference 
over  custoaers  in  class  j,  if  i<j.  Custoaers  within  a  priority  class 
are  served  with  respect  to  that  class  by  the  FCFS  rule. 

It  is  also  assuaed  that  the  arrival  process  is  Poisson.  More 
precisely,  class  i  custoaers  arrive  froa  a  Poisson  source  at  an  average 
rate  of  Xj.  Hence  the  coabined  arrival  process  is  Poisson  with  rate  X, 
where  X  «  Xj^  +  Xj  +  ***  +  XQ.  Bach  class  of  custoaers  aay  have  its  own 
general  service  tiae  distribution.  Hence,  the  coabined  PDF  of  the 
service  tiae  is  given  by 


B(r)  ■  Bttj)  ♦  ***  +  r—  B(rn)  ,  (4.41) 

where 

B(t£)  ■  PDF  of  the  service  tiae  for  clsss  i  custoaers, 

and 


X 


Probability  the  customer  receiving  service 
belongs  to  class  i. 


It  follows  that  the  expected  value  and  second  aoaent  of  the  service 
tiae  are  respectively: 

E[S]  -  E[S, ]  +  ~  EIS-]  ♦  •••  ♦  ElS]  .  (4.42) 

X  A  X  *•  X  “ 

ElS2]  -  E[S,2]  +  ElS-2]  +  •••  +  ~  ElS  2]  .  (4.43) 

Since  on  the  average  X^  cnstoaers  arrive  per  second  and  these 
cnstoaers  require  an  average  of  EtSj]  seoonds  of  service,  then  X^EIS^] 
is  the  percentage  of  tine  the  server  is  serving  olass  i  cnstoaers. 
There fore, 

P  -  Pi  +  P2  ♦  +  Pn» 

where 

pt  -  X jE C S ^ ]  .  (4.44) 

Now  suppose  that  a  cnstoaer  of  priority  i  arrives  at  the  systea  st 
tiae  tQ  and  starts  to  reoeive  service  s  tiae  tj.  His  wsiting  tiae  is 
thus  tjj  ■  t^-t^.  At  tQ  let  there  be  kj  ( jsl,2,..., i)  cnstoaers  of  class 
j  ahead  of  the  arriving  cnstoaers,  snd  let  there  be  either  one  or  no 
cnstoaers  in  servioe  at  tQ.  Also  let  kj'  (j-1,2,..., i-1)  represent  the 
nnaber  of  class  j  onstoaers  that  arrive  during  rq,  and  hence  receive 
service  before  the  cnstoaer  who  arrived  at  tQ.  Nov  let 

Vj  ”  total  tiae  required  to  service  the  kj  cnstoaers, 

•c,'  “  total  tiae  required  to  service  the  k.  *  cnstoaers, 
and  J  J 

Tq  “  the  tiae  required  to  finish  serving  the  cnstoaer 
in  service  at  tQ. 


W’rfwvwv  ▼WVTWWWWW  V  WWW’jr’  r*  V*  vrw/tvvinuflrjinvuvwi  iv-  ".-.jvtv  mrmr?nn*rrmj*' 


It  follows  that 


1-i  i 

*«  "  }  xi'  +  2  TJ  +  t0  ' 

J-l  j-l 


(4.45) 


lid 


Wqi  -  E[xq]  -  \  B[t j ' ]  +  \  Ettj]  +  E[t0]  .  (4.46) 

j-l  j-l 

where  fqi  is  the  sun  waiting  tias  of  s  olsss  i  customer. 

Siaoe  kj  sad  Sj  srs  independent  random  variable  it  ia  easily  seen 


tkat 


Btxj]  -  E[kj ]  E[Sj ] . 


Dtilixing  Little's  law  yields 


Heaoe. 


Similarly. 


BtkjJ 


Eltj]  -  XjEtSjl 

“  >j  V 

Bltj'l  -  Pj  Wqi. 


(4.47) 


(4.48) 


(4.48) 


(4.50) 


'aV. 


Substituting  these  results  into  the  previous  equation  for  Wq^  yields 


wqi  “  wqi  J  Pj  +  \  Pj  wqj  +  EtTol  » 


(4.51) 


j-l  j-l 


•v'v< 

^  w  J 


or 


\  pj  fqj 
j-i 


Elt0l 


qi 


(4.52) 


1  -  o<_ 


i-1 


v.AV 

< 
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8 


By  iadactioa  oa  i  on*  obtains 


E[Sil  +  fqi. 


(4.57) 


Lqi  "  Xi  fqi* 
Li  "  Xi  £i* 


(4.58) 

(4.59) 


Tk«  only  othir  equation  that  has  been  derived  for  the 
nonpreeaptive  queueing  discipline  is  the  Tarianee  of  the  response  tine. 
The  equation  is  given  without  proof  : 


Var[W] 


▼ar[Si]  + 


XE[S3] 

m-Oi-ll^i-p] 


XE[S2]  2 


XjE[Sj2]-XE[S2]] 


+  . . . . .  . 

4[l-oi.1]2U-pl 


XE[S2]  J  XjE[Sj2l 

j-1 

+  - ; -  (4.60) 

m-oi-i^u-pj 

[LAVE83].  Unfortunately,  these  are  all  the  equations  that  have  been 
derived  for  the  nonpreeaptive  priority  qneneing  diseipline.  They  are 
far  short  of  what  one  would  need  in  order  to  deteraine  the  queue  size 
or  buffer  size  so  that  overflow  does  not  occur. 

The  behavior  of  priority  queues  is  illustrated  graphically  in 
Figures  4.6,  and  4.7.  Figure  4.6  is  plot  of  Lj,  Lj.  Lj,  and  Lj  (total) 
for  the  M/M/1  priority  systea.  It  is  assuaed  that  all  arrival  rates  and 
service  tiae  distributions  are  the  sane  for  all  three  classes.  It 
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Mean  Number  in  the  System 


ehoald  mot  bo  aarpriaiag  tbot  Lj  i*  tbo  imi  os  tho  M/M/1  ayatea  with 
oao  elmos  tad  oa  arriral  cat#  of  X1+X2+X).  Figaro  4.7  io  o  plot  of  tho 


aoraolisod  aooa  roopoaoo  tiao  (E[S]-1)  for  tho  ooao  ayatea.  Noto  that 


ia  both  figaroa  tho  aorrioo  diaeipliae  haa  tho  aoat  offoot  oa  tho  olaaa 


with  tho  lovoat  priority  (i-3).  Fi| 


liaili 


Figaroa  4.d  aad  4.7  ozeopt  that  tho  aorrioo  tiao  ia  dotoraiaiatio. 


Tho  M/O/a  aodol  roproaoats  tho  eoatoatioa  for  a  idoatioal  sorrora 


that  oporato  iadopoadoatly  ia  parallel  aador  tho  aaaaaptioa  that  tho 


arriral  proooaa  ia  Poiaaoa.  Thna,  thla  aodol  ia  a  goaoralixat ion  of  tho 


M/M/a  aodol.  Althoagh  thia  aodol  ia  oftoa  oaeoaatorod  ia  praotico. 


aaalytieal  roaalta  haro  aot  booa  obtaiaod  for  it.  Tho  priaary  roason 


for  thia  ia  that  it  ia  aot  a  aoai-Marhor  proooaa.  Mora  prooiaoly  tho 


naabor  of  oaatoaora  ia  tho  ayatoa  at  tho  dopartaro  instanta  ia  not 


oaoagh  iaforaatioa  to  prodiet  fataro  boharior.  Information  coacorning 


tho  aaonnt  of  aorrioo  roooirod  by  oaatoaora  at  tho  othor  aorrora  ia 


roloraat.  Honco.  tho  aratoa  dooa  sot  poaaoaa  an  oaboddod  Markor  chain 


£i  lift  4ojUtTl.»yt  iaatanta. 


Tho  G/M/l  qaoaoiag  aodol  roproaoata  tho  eoatoatioa  for  a  ainglo 


terror  aador  tho  aaaaaptioa  that  tho  iatorarriral  tinea  haro  a  general 


diatribatioa  aad  that  the  aorrioo  tinea  hare  aa  exponential 


diatribation.  Compared  to  the  M/G/l  aodol  for  aaalytieal  roaalta  are 


arailable. 


¥ 

KS. 


tty: 

*>  ■**  •  •• 


8 


J»  W’’ 


.  '  k  "J.  ^ 

%*  A 

%  V  % 

wZts 


v  V  V' 

.  *  -  * .  < 


S/V  •/'l 

4 


W-7 


.N.S 


. v  -v-y 


Pig«r«  4.*  Cwrwoa  of  lj,  «j,  I3  and  I  for  a  M/D/1  Priority 
Syatan  with  Thraa  Cnatoaar  Claaaaa. 
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Siaoe  tki  arrival  prooaaa  ia  aot  aeaoryleaa,  tka  proeaaa  ia  sot 


Markoviaa.  Ho v*T*r,  if  tka  ayatea  ia  obaerved  oaly  jaat  bafora  aa 


arrival,  it  appaara  to  ba  a  diaorata-tiaa  Markov  okaia.  Haaoa,  tka 


proeaaa  ia  a  aaai-Markov  prooaaa  vitk  aa  aabaddad  okaia.  Uafortaaately, 


tka  aolmtioa  at  tkaaa  aabaddad  poiata  ia  aot  tka  aolatioa  for  all 


poiata  ia  tiaa  [COHE69]  [6BOS74]  [CINL75].  Hovavar,  it  ia  poaaibla  to 


dataraiaa  tka  aaaa  valaaa  of  tka  parforaaaea  paraaatars  froa  tka 


aolatioa  at  tkaaa  poiata. 


Siaea  tka  aolatioa  at  tkaaa  aabaddad  poiata  ia  aot  tka  ateady- 


atata  aolatioa  for  all  tiaa,  tka  ayabol  will  aot  ba  aaad  to 


rapraaaat  tka  liaitiag  probabilitiaa.  Iaataad  tka  ayabol  «k  will  ba 


aaad.  Tkaa,  tka  diaerata-tiaa  liaitiag  probability  eqaatioa  becoaea 


[An, H.,  •••  1  *  [Aa,A. ,  ...  ]  [P]  , 


(4.61) 


wkara  [P]  ia  tka  oaa-atap  traaaitioa  aatriz. 


Tka  atata-traaaitioa-probability  diagraa  for  tka  G/M/l  model  ia 


depicted  ia  Figara  4.10.  Note  tkat  a  traaaitioa  froa  atata  i  to  j  where 


© 


Figara  4.10  State-Traaaitioa-Probability  Diagraa  for  tka  G/M/l  Syatea. 
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j>i+l  is  an  iapossibl*  situation  sinoa  only  on#  arrival  eaa  occur 
during  an  intsrarrival  period.  On  tbs  other  hand*  up  to  l+l  departures 
oan  ooour  during  an  intsrarrival  period,  therefore  all  transitions  to 
state  j  where  O^j^i+l  are  possible. 

In  order  to  deteraine  the  fora  of  the  one-step  transition  aatriz, 
note  that  the  following  relationship  exist  between  states  and  XB 

Xn+1  "  xn  +  1  “  Bn'  <*•«> 

where  Bn  denotes  the  nuaber  of  departures  between  the  nth  and  (n+-l)th 

arrival.  Thus,  the  fora  of  the  one-step  transition  aatrix  is 


l-bQ  bQ  0 


0 


0 


0 


0 


I  I  (4.63) 
where  bn  ■  P[n  services  during  an  intsrarrival  period].  Recall  that  the 
eleaents  of  the  one-step  transition  aatrix  are  and  note  that 
n-i+l-j.  Also  note  that  the  case  j«*0  is  treated  separately  because,  if 
j“0,  it  is  not  sufficient  to  say  that  i+l-j  custoaers  were  served 


during  an  interarrival  period.  That  is,  they  could  have  been  served  in 


Ia  order  to  calculate  ba,  recall  that  if  the  service  procasa  it 
Markovian,  tha  service  tiaa  ia  exponentially  diatribatad.  Haaea,  aa 
loag  aa  thara  ara  oaatoaara  to  ba  served,  tha  anaber  of  services  ia  any 
laagth  of  tiaa  t  ia  a  Poiaaoa  raadoa  variable  with  aaaa  pt.  Tha  a,  if 
A(t)  ia  tha  PDF  of  tha  interarrival  tiaes,  thaa  bp  eoaditioaiag  oa  tha 
tiaa  batwaaa  aaooaaaiwa  arrival a: 

m  a“,it(pt)* 

bn  -  |  - - —  dA(t)  0£n<i+l  .  (4.63) 


Henoe,  ia  ooapoaaat  fora  tha  liaitiag  probability  equation  baooaaa: 

■k  *  J  n^+n-i  bn  k)l(  (4.66) 


or 


nk 


-  e^pt)* 
f  - - -  dA(t) 

J-  a! 


k>l. 


(4.67) 


The  Hq  equation  haa  not  been  included  aince  it  containa  no  new 
inforaation,  it  ia  redundant.  The  value  ttq  can  be  deterained  froa  the 
fact  that  the  liaiting  probabilitiea  aust  aua  to  one. 

Unfortunately,  there  is  no  easy  way  to  solve  this  last  equation, 
however,  it  haa  been  proven  that  if  p/X  <  1  (the  necessary  condition 
for  tha  liaiting  probabilities  to  exist),  than  tha  fora  of  the  solution 

*•  k 

Jik  ■  cp  ,  (4.68) 

where  P  ■  a  nuaber  between  0  and  1, 


and 


c  ■  a  constant  which  will  ba  deterained 


[TALA42].  Sab  at  i  tat  lap  thia  late  tk*  last  nutin  l«Ui  ta  : 


«*k 


4A(t) 


k>l 


.  f  "  .  •  <*■»*)• 
aSk_1  f  J  — — —  dA(  t) 

0  a-0 


opk-l  f  .-Htd-I)  mt)  . 

Jo 


(4.(9) 


■not, 


f  m  j  #-|»(l-P)t  dA(t)  # 


(4.70) 


Obaarwa  that  thia  laat  aqaatioa  ia  jaat  tha  Laplaea  trass fora  of  a(t) 
•▼alaatad  at  |i(l-0).  That  ia 


0  **  a*(a)  -  a*(n~aP). 

•-ji(l-p) 


(4.71) 


Tha  azaot  walaa  of  0  asaally  eat  only  ba  dataraiaad  by  naaarical 
aaalyaia  (anoh  aa  Naw tea's  aathod). 

Tha  ooaataat  e  oaa  ba  dataraiaad  froa 

m 

W*l,  (4.72) 

k-0 


which  iapliaa 


I 


The  aean  values  of  the  other  perforaance  paraaeters 

easily  follow: 

L  -  XE  -  — - -  * 

JiU-0> 

(4.78) 

w  *  .. 

*  8  |i(l-p> 

(4.79) 

L  -XI  -  • 

4  4  n(l-p) 

(4.80) 

The  G/M/a  queueing  aodel  represent*  the  contention  for  a  identical 
severs  that  operate  independently  and  in  parallel  under  the  sssnaption 
that  the  interarrival  tiaes  have  an  exponential  distribution.  Siailar 
to  the  G/M/l  systea  if  this  systea  is  observed  at  the  arrival  instants 
then  it  appears  to  be  a  Markov  chain.  Henoe  it  is  possible  to  calculate 
the  probability  that  an  arriving  custoaer  finds  k  custoaers  in  the 
systea.  However,  no  one  has  been  able  to  derive  explicit  expressions 
for  any  perforaance  paraaeter.  The  details  of  the  analysis  are 
significantly  aore  eoaplioated  than  those  for  the  G/M/l  systea  and  will 
not  be  given  here.  The  interested  reader  is  referred  to  Gross  and 
Cl e inrook  [GB0S74]  [ELEI75]. 


c 


prooeaa.  Thar* fora,  if  ralatioaakipa  comld  ba  davalopad  that  ralata  tka 
solmtiom  of  a  aaai-Markor  proaaaa  to  tkat  of  ita  gaaaral  tiaa  prooaaa, 
tkaa  tka  M/M/1,  M/6/1,  a  ad  6/M/l  ayataaa  ooald  all  ba  aaalyzad  as  aaai- 
Markor  proaaaaaa.  Iadaad  amok  ralat ioaakipa  kava  baaa  daralopad 
[FABB61]  [CINL69]  [CINL73I.  lowerer,  aaok  oaaa  aaat  ba  traatad  aa  a 
aaparata  problaa.  Tka  daralopaaat  of  tka  ralatioaakipa  dapaada  apoa 
raaaval  theory,  aad  raqairaa  far  too  aaok  baokgroaad  aatarial  to  ba 
praaaatad  here.  Tka  iataraatad  raadar  ia  rafarrad  to  tka  rafaraaeaa  by 
Cialar,  vko  daralopad  aaok  of  tka  tkaory.  Tka  aaalyaia  ia  by  ao  aaaaa 
aiapla.  Tka  aatkor  apaada  aa  aatira  ekaptar  (ekaptar  10)  derelopiag  tka 
ralatioaakipa  for  tka  M/6/1  aad  6/M/l  aaaaa  [CINL7S].  Tka  priaary 
raaalta  ara  tkat  tka  aolatioa  of  tka  aaai-Markor  prooaaa  for  tka  M/6/1 
caaa  ia  tka  aaaa  aa  tka  gaaaral  tiaa  aolatioa,  akoraaa  tka  gaaaral  tiaa 
aolatioa  for  tka  6/M/l  oaaa  ia 

X  _ 

1 -  k-0 

■ 

Pk  " 

■ 

-  )W(H)  kil.  (4.81) 


m 


It  ia  aoaavkat  iroaie  tkat  tka  proof  for  tka  M/6/1  oaaa  ia  coaaidarably 
aora  ooaplieatad  tkaa  tkat  for  tka  6/M/l  oaaa. 


4.4  Coaaaata  oa  tka  6/6/1  Qaaaalaa  Modal 

Tka  6/6/1  qaaaaiag  aodal  rapraaaata  ooataatioa  for  a  aiagla  •error 
under  tka  eonditioaa  that  both  tka  iatararriral  tiaaa  aad  tka  aarrica 


tiaaa  kara  gaaaral  diatr ibatioaa.  Claarly,  thia  oaaa  iaeladaa  the 


M/M/1,  M/6/1,  tad  G/M/l  oasts.  Therefore,  if  a  solution  could  be 
obtsiasd  in  tsras  of  tbs  systsa  psrsastsrs  it  would  bs  valid  for  tbs 
otbsr  easss.  Unfortunately  ao  oas  baa  dsrivad  suob  solution. 


Tbs  diffioulty  ia  analysing  tbs  aodsl  stsas  froa  tbs  fact  that 
asitbsr  tbs  arrival  aor  carries  proosss  is  asnorylsss.  Hsncs,  it  is  not 
possible  to  dsfias  a  Markov  or  ssai-Markov  proosss  whsrs  tbs  stats  of 
tbs  systsa  rsprsssats  tbs  auabsr  of  custoasr.  Hovsvsr,  it  is  possible 
to  dsfias  a  ssai-Markov  process  vbsrs  tbs  stats  rsprsssats  tbs  aaount 
of  unfinished  work  ia  tbs  systsa.  Tbs  sabsddsd  process  is  obtsiasd  by 
looking  at  tbs  systsa  only  at  custoasr  arrival  iastaats.  Thus,  tbs 
unfinished  work  at  these  poiats  is  tbs  sans  as  tbs  custoaers  response 
tiae,  R. 

Tbs  details  of  tbs  aaalysis  will  aot  bs  covered  here,  but  sons 
coaasnts  on  tbs  analysis  and  fora  of  tbs  solution  will  tre  discussed. 
Tbs  ssai-Markov  process  is  a  discrete-tine  continuous-stats  process. 
Note  that  this  is  our  first  encounter  with  a  proosss  in  whioh  tbs  state 
space  is  continuous.  Tbs  key  point  hers  is  that  in  order  to  obtain  a 
solution  for  tbs  waiting  tins,  coaplsx  variable  theory  and  spectral 
factoring  aust  bs  used.  Tbs  procedure  involves  a  oertain  aaount  of 
trial  and  error.  Unfortunately,  tbs  spectral  factoring  procedure 
destroys  all  traces  of  tbs  systsa  paraastsrs.  That  is,  although  it  nay 
bs  possible  to  find  a  solution,  it  will  not  be  in  terns  of  any  of  the 
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systsa  paraastsrs.  However,  sssuniag  that  a  solution  can  bs  found,  the 
expected  values  of  tbs  other  perfornsnee  paraastsrs  can  be  determined 
froa  the  waiting  tiae. 
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Although  It  i*  not  yet  possible  to  find  sn  expression,  in  terns  of 
the  system  parameter,  it  is  possible  to  derive  sn  expression  for  the 


npper  bound  of  L  and  K.  The  result 


.  .  X2(Vsr[nl+VsrtS])  . 
L*P  + - 2 <W> - 


(4.82) 


R1E[S] 

-1  1  J  2(l-p) 


(4.83) 


where 


i)  •  random  variable  representing  the  interarrival  time. 


[LAVE83]. 


All  of  the  comments  on  the  6/6/1  system  oarry  over  to  the  6/G/m 
case.  However,  the  likelihood  of  solving  the  integral  equation  by 
speoial  factoring  is  considerable  less  than  the  6/6/1  case  (usually 
impossible  [KLBI76]).  Bounds  on  L  and  R  have  been  derived  [LAVE83]: 


.  .  X2[Var[q]+(Var[SJ/n)] 

+ - ioT) - 


(4.84) 


f  1  E[S]  ♦ 


XtVsrhl-KVartSl/m)]  # 
2 ( 1-p ) 


(4.85) 


V*-  a'  -  Vs  L'- 


■  v  LV  /* .%  *. 


4.5 


The  primary  purpose  of  this  chapter  was  to  develop  the  elementary 
results  for  the  M/G/l  and  G/M/l  systems.  It  is  not  possible  to  eover 
all  of  the  details  of  these  two  systems  in  a  single  chapter.  Indeed 
entire  books  have  been  devoted  to  oovering  these  tvo  systems.  Perhaps 
the  most  comprehensive  reference  is  The  Single  Server  Queue*  by  Cohen 
[C0HE69].  This  reference  oontains  over  600  pagesl 


CHAPTER  S 


INTRODUCTION  TO  HARROVIAN  QUEUEING  NETWORKS 

S.l  Introduction  to  Queuoina  Networks 

A  qwsilai  network  it  a  collection  of  oao  or  aoro  service  centers. 
Only  networks  of  Markovian  queues  will  be  considered  ia  this  chapter.  A 
Markovian  network  ia  one  in  wkiok  all  arrivals  froa  ontaide  the  network 
are  Poiaaon  proeeaaea  and  all  service  tiaes  are  exponentially 
diatribnted.  The  purpose  of  a  queueing  network  ia  to  predict  the 
perforaaace  of  a  physical  systaa  in  which  there  ia  contention  for 
reaonreea.  The  reaonrcea  are  represented  by  the  servers  ia  the  network. 
Qneneing  networks  are  usually  classified  as  being  either  open  or  closed 
An  open  network  in  depicted  in  Figure  S.l.  A  cnstoaer  enters  one  of  the 
service  centers  froa  ontside  the  systea,  waits  for  a  server  to  becoae 
free,  receives  service,  and  departs  the  service  center.  Upon  departing 
froa  the  service  center  the  cnstoaer,  according  to  fixed  routing 
probabilities,  either  enters  another  service  center,  reenters  the  saae 
service  center  or  exits  the  systea.  Open  networks  are  used  to  aodel 
systeas  in  which  the  nnaber  of  cnstoaers  coapeting  for  resources  can 
be  potentially  unliaited.  A  closed  queueing  network  is  shown  in  Figure 
S.2.  In  a  closed  queueing  network  the  nuaber  of  cnstoaers  in  the  systea 
is  always  constant.  After  a  cnstoaer  coapletes  service  at  a  service 
center,  he  either  enters  another  service  center  or  reenters  the  saae 
service  center.  Closed  networks  are  used  to  aodel  systeas  in  which  s 
fixed  nuaber  of  cnstoaers  contend  for  the  resources. 
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Qa«a«iag  Network. 


Figare  5.3  A  Siaple  Tiadta  Quwiif  Network. 

ceatars  ooataia  a  alagla  larvar  tad  that  tha  service  tiaaa  ara 
expooeat iaily  diatribatad  with  aeaa  1/ga^  at  aoda  oaa  a  ad  l/pj  at  aoda 
two.  Also  aaaaaa  that  tka  arrival  proeaaa  to  aoda  oaa  la  Poiaaoa  with 
rata  h.  Tha  a  tha  firat  aoda  la  exaetly  aa  M/M/l  qaaaa.  la  ordar  to 
aaalyxa  tha  aaeoad  aoda  tka  arrival  proeaaa  faadiag  it  aaat  ba 
calealatad.  Clearly,  thia  ia  tka  dapartara  process  of  aoda  oaa.  Let 
D(t)  daaota  tka  PDF  of  tka  iatardapar tare  tiaa  batwaaa  castoaeri 
laaviag  aoda  oaa.  Vkaa  a  eaatoaer  departs  aoda  oaa,  either  a  aaeoad 
oastoaar  iaaediately  starts  service  or  tka  qaaaa  ia  aapty.  If  tha  qaaaa 
is  aapty,  thaa  tka  tiaa  aatil  tha  aaat  oastoaar  departs  is  tha  saa  of 
two  iadapaadaat  raadoa  variables:  tha  firat  baiag  tka  tiaa  aatil  a  aaw 
eaatoaer  arrives  aad  tha  aaeoad  his  service  tiaa.  Tha  daasity  faaetioa 
of  tha  saa  of  two  iadapaadaat  raadoa  variables  is  tha  eoavolatioa  of 
tha  iadividaal  daasity  faaetioas  [KLEI75],  Thsrefore,  it  is  easier  to 
work  with  tha  daasity  faaetioa  aad  Laplaea  traasforas  aad  thea  convert 


back.  La t  d(t)  denote  tha  density  faaotioa  of  tka  iaterdeparture 
proaaaa  at  service  eaatar  oaa  aad  d*(s)  ita  Laplaea  transform.  Tha 


aoaditioaal  Lapli 


i fora  daaaitii 


d*(S) Inode  oaa  empty  •  - 

s 

d*(S) Inode  oaa  nonempty 


S+X  s+|t 


(5.1) 


(5.2) 


«hara  tha  sabserlpts  have  baaa  sappraaaad  aiaoa  all  variables  pertain 
to  service  eaatar  oaa.  Tha  probability  that  aa  M/M/l  queue  is  nonempty 
was  ealcalatad  aarliar  aad  is  X/p.  Therefore  tha  aaooaditioaal  Laplace 
transform  density  is 


**<»  ■  [*- 1]  [^r  A]  *  ft  sij]  ' 


(5.3) 


d(t)  -  Xa"Xt. 


Hence,  tha  iatardapartara  PDF  is 


D(t)  -  1  -  aXt. 


(5.4) 


(5.5) 


tha  arrival  process!  This  startling  result  is  usually  referred  to  as 
Burke's  theorem  [BUKK5<].  Ha  also  proved  that  tha  same  was  true  for  an 

M/M/m  queue. 

Ia  view  of  Burke's  theorem,  service  center  two  is  also  an  M/M/l 
queue  with  mean  arrival  rata  X  aad  can  be  analyzed  independently  of 
node  oaa.  It  follows  that  tha  joint  probability  of  node  one  contsining 
kj  customers  aad  node  two  ooataiaiag  k2  customers  is 

P(k1,k2)  -  P1(k1)  P2(kj) 


tfMvivlWi*!1 


-  [a/i4)kl  p1(o>]  [(x/n2>k2  p2(o>] 

-  tX/p^1  [l-tx/nj)]  (X/^)k2  [l-(X/n2)l.  (5.6) 

5.3  Open  Queue ins  Networks  and  Jackson's  Product  Fora  Thcorca 

Shortly  after  Burke  published  hit  work  Jackson  proved  that  more 
general  networks  can  be  analyzed  in  a  siailar  Banner  [JACX57].  The  type 
of  networks  he  studied  is  depicted  in  Figure  5.1  .  It  consists  of  N 
interconnected  nodes.  Node  i  in  the  network  contains  a^  identical 
servers.  The  service  tiae  of  a  cuatoaer  visiting  node  i  is 
exponentially  distributed  with  aean  l/|ij.  A  custoaer  after  receiving 
service  at  node  i  is  routed  to  node  j  according  to  probability  r^j,  or 
he  reenters  node  i  according  to  probability  r^j,  or  he  exits  the 
network  according  to  probability  r^Q.  In  addition  to  receiving 
custoaers  froa  other  nodes,  node  i  aay  receives  custoaers  froa  a 
Poisson  process  outside  the  network  at  aean  rate  X^. 

Let  Yi  denote  the  total  aean  arrival  rate  at  node  i  (arrivals  froa 
outside  the  network  plus  those  froa  other  nodes  inside  the  network). 
Since  the  expected  value  of  the  sub  of  several  randoa  variables  is  the 
sua  of  the  individual  expected  values  (irrespective  of  dependencies 
involved),  it  follows  that  at  steady-state 


Ti  *  Xi  +  )  Yj  *ji  . 

j-1 


(5.7) 


where  Yj  * j *  i«  the  aean  rate  froa  node  j  to  i.  Bence  a  set  of  N 
linear,  siaultaneous  equations  can  be  written  froa  which  the  aean 
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arrival  rata  at  each  node  caa  be  detaraiaed.  It  alto  follow*  that  the 


aaaa  throughput,  T^  “  yj. 

Jaoksoa  prowad  for  thia  class  of  aetworks  that  the  joiat 
probability  diatributioa  is 


where 


w 


p(k1*k2....#k||>  -  P2(k2)  ••• 

P£(0)  (t£/ Pi)^1  /  ki» 


■ 


Pj(0)  (Ti/pj)  /  (aiI 


PN(kN)  (5.8) 

(kj  ■  0,1, . , . .Bj) 

(kj  m  a^.a^+l,...)  « 


Note  that  P|(kj)  ia  the  aaaa  aquatioa  that  was  derived  earlier  for  aa 
M/M/a  queue  ezoept  yA  has  replaced  Xj.  The  result  is  kaowa  as  Jacksoa’s 
product  fora  theorea. 

The  proof  closely  parallels  that  of  the  birth  aad  death  aodel  ia 
chapter  three.  Ia  fact  a  aetwork  of  Markoviaa  queues  is  a 
aultidiaeasioaal  birth  aad  death  aodel.  Becall  that  for  the  one- 
diaeasioaal  birth  aad  death  aodel  the  probability  of  zero  births  ia  aa 
iafiaitesiaal  iaterval  h  is  l-Xh+o(h).  It  follows  that  for  a  aetwork  of 
N  aodes  the  probability  of  zero  births  ia  h  is 


[l-Xih+oOO]  [l-X2h+o(h)]  ...  [l-XNh+o(h)J  -  1  -  ^  xih  +  o(h)  •  (5-9) 

i-1 

Siailsrly,  the  probability  of  zero  deaths  at  aode  i  is 


1  -  n ^ ( k t )  h  +  o(h)  ,  (5.10) 

where 


r k£  H  for  kil«i 

-  < 

k*i  i»i  fox  k l2ml 


l»4  -  ■•an  sorrio*  rat*  at  qa*a*  i  vh*n  kj-1 
k^  -  tk*  nnabar  of  customers  at  aarrie*  center  1 
■|  -  tk*  nnabar  of  s*rr*rs  at  e*at*r  i. 


Tk*  probability  of  z*ro  d*atka  in  tk*  natvorka  is 

1  -  ^  Hi<ki)  k  +  o(k)  . 
i-1 

and  tk*  joint  probability  of  s*ro  birtks  and  z*ro  deatks  is 

1  -  Xt  k  -  jj|  pi(kj)  k  ♦  o(k)  . 
i-1  i-1 


(S.ll) 


(5.12) 


By  considering  all  tk*  nays  in  which  a  network  can  reack  state 
(k1.k2,...,kN)  it  tnrns  ont  tkat 

P(kr . kN)(t+k)  -  [l  -  j|  Xt  k  -  |a1<lr1)  k  ]  P(kx . kN)(t) 


i-1 


i-1 


+  \  kt  k  P(k1,...,ki-1 . kN)(t) 

i-1 


+  2  l*i(k£+l)  k  rjQ  P(kj, . . .  ,k£+l, . . .  ,kj()  ( t) 
i-1 

♦f  l  Pj  (kj+l-d^j )  k  rjj  P(kj, . . .  ,kj+l, . . .  ,kj-l, . . .  ,kj^)  ( t) 
l-l  j-1 


+  o(k)  , 


(5.13) 
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V.1  tor  imi  • 

The  first  tsra  on  the  right  has  already  baea  explained.  The  second  tern 
on  the  right  is  the  probability  that  the  network  is  in  state 
(k£#...,k j-l,....kjf),  and  an  arrival  oeonrs  at  node  i  in  tine  h.  State 
(k.  ,...,kj-l,...,kjg)  indicates  that  service  center  i  has  one  less 
enstoaer  than  state  (k^,...,k£,....kjf).  The  third  tern  is  the 
probability  of  the  network  being  in  state  (k£,...,k£+l,...,kN),  and  a 
departure  occurs  at  aerwice  center  i,  and  the  departing  custoaer  exits 
the  network.  The  fourth  tern  is  the  probability  that  the  network  is  in 
state  (kj,...,kj+l,...,k  j-l,...,^),  and  a  departure  occurs  at  service 
center  j,  and  the  departing  custoner  goea  to  service  center  i.  The 
terns  allow  for  the  possibility  that  a  departing  custoner  reenters  the 
sane  service  center. 

Following  the  usual  procedure  of  subtracting  P(k^,...,kN)(t)  from 
both  sides,  dividing  by  h  and  taking  the  liait  as  h  approaches  zero, 
one  obtains  a  set  of  differential  equations.  A  set  of  steady-state 
equations  is  then  obtained  by  taking  the  linit  as  t  approaches 
infinity.  The  resulting  steady-state  equations  are  : 


[  *i  +  ^  ■,i(ki)]  P(kl . kN>  "  ^  *i  *<kl . ki-l« 


i-1  i-1 


+  2  **i<ki+1)  ri0  P(ki,....ki+l,...»kN) 
i-1 


’  i,WW  s'  s*V  V-"-  'V-  ,  ■r.  sj.-.  s 


<*  t 


♦  2  2  Ckj-*-X— 6i  J )  rj!  P(k1,....kj+l....,k1-l,....kN)* 

i-1  j-1 

(5.14) 

Jackson  did  not  derive  tki  solution  fro*  this  set  of  eqnstions  ss 
was  done  in  the  one-dimensional  case,,  Be  assumed  the  solntion  and  then 
verified  that  his  assumption  was  correct  bp  substituting  it  into  these 
equations.  Ike  following  relations  are  easily  seen  from  the  defining 
equation  for  P(k^<k2«....k^)  : 


P(k1,...,ki-l.....kN)  Pitkj) 

P(k1,...,k1,...,kN)  Yj 


(5.15) 


P(k. , . . . ,k. # . . . , ku) 


Pi (kj+1) 


(5.16) 


P(k1 k k. .... , kN) 


Ti  Pj<kj+1“4ij^ 


Dividing  both  sides  of  the  steady-state  equation  by  P(k1(...,kN) 


results  in  : 


5  Xi  +  5  •*i(ki)  "  5  “i(ki)  /  Ti  +  \  Ti  ri0 

i«l  i-i 


^  5  Ti  Pi<ki>  *ji  f  Ti 

j-1  i-1 


(5.18) 


Substituting  Xj  -  Ti  ♦  )  TJ  r j i  int0  tk*  fir,t  summation  on  the  right 


I 


and  adding  the  result  to  the  doable  suaaation  yields: 


2  Xi  +  }  *i<ki>  "  )  *i  ri0  +  )  l*i<ki>  •  (5.19) 

i«l  i-1  i»l 


Finally,  sobstitnting  rjg  *  1  -5  *ij  Ti  ■  ki  +  f  Yj  *ji  into 

j-1  j-1 

the  last  equation  results  in  both  sides  becoming  identical,  and  the 
proof  is  completed. 

Jackson's  product  forai  theorem  states  that  once  the  aean  arrival 
rates  have  been  deterained,  each  service  center  oan  be  analyzed  as  an 
independent  M/M/a  queue.  As  in  the  case  of  the  M/M/a  queue  the  service 
discipline  or  order  in  which  custoaers  are  served  is  nniaportant  as 
long  as  it  is  work-conservative.  The  results  of  Jackson'  theorem  can 
best  be  illustrated  by  an  ezaaple.  Consider  the  problem  of  finding  the 
distribution  of  custoaers  in  the  network  in  Figure  5.4.  Assuae  that 


(X+l^)  P<1,0)  -  X  P(O.O)  +  r2a  |»2  P(0,1>  +  *2,0  *1  p<2»2> 

(X+lij)  P(0,1)  -  Iij  P(1,0)  +  r2<0  n2  P(0,2) 

(X+iij)  P(2,0)  -  X  P(l.O)  +  t21  P(l,l>  +  r2  Q  P<2,1> 

(X+iij)  P(0,2)  -  |i1  P(l,l)  ♦  *2,0  P<°»3> 

(X+Hj+n^PU.l)  -  X  P(O.l)  +  14  P(2,0)  ♦  r2<1  1 12  P(0»2) 

+  *2,0  *2  p*2»2)* 

Notie*  that  there  are  tix  equations  and  nine  unknowns.  No  natter  how 
nany  and  what  set  of  equations  are  written  out  there  will  always  be 
nor*  unknowns  than  equations.  Thus,  there  is  no  way  to  solw*  this  set 
of  equations  without  son*  forn  of  guessing. 

Aeeording  to  Jaekson's  theoren  the  solution  is 

P(k1,k2)  -  (Ti/hi)*1  P2(0)  <T2/P2>k2  p2<°>  • ' 
where  y2  and  y2  are  the  ness  arrival  rates.  The  equations  for  r2  r2 
are: 

Ti  -  X  +  r2  r2>1 
T2  “  T1  * 

Solving  these  equations  results  in  y2  ■  y2  “  ^r2,0*  *®*°lts  in 

PCkj,^)  -  (X/r2>0)kl+k2  <l/n1)kl  (l/n2)k2  P(0.0)  . 

It  is  easy  to  verify  that  this  satisfies  the  steady-stats  equations, 
and  thus  is  the  solution. 


am 
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without  feedback.  If  Poisson  processes  are  joined  or  split  the 
resulting  processes  are  Poisson.  Using  this  fact  and  Burke's  theorea  it 
can  easily  be  shown  that  for  a  network  without  feedback  the  arrival 
process  at  node  i  is  Poisson  with  aean  rate  tj. 

The  oroblen  with  feedback  is  that  it  oan  be  proved  that  the 
arrival  processes  at  service  centers  in  a  feedback  loon  are  not  Poisson 
[LEM 07 7] .  This  fact  can  be  illustrated  best  by  an  exaaple.  Again  using 
Figure  5.4  assuae  that  custoaers  arrive  froa  outside  the  network  froa  a 
Poisson  source  at  an  rate  of  one  eustoaer  per  hour,  and  that  the  aean 
service  tiaes  at  both  service  centers  is  exponentially  distributed  with 
a  aean  of  1  asec.  Also,  assuae  that  the  output  froa  the  second  service 
center  is  fed  back  to  first  with  probability  r21*  0.999.  With  this 
extreae  set  of  paraaeters  the  output  of  the  first  service  center  tends 
to  be  in  bursts.  A  typical  output  sequence  is  shown  in  Fi'gure  5.5.  The 
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Figure  5.5  A  Non-Poisson  Input  Sequence. 


input  to  the  second  service  center  does  not  have  independent 
increaents,  and  therefore  is  not  Poisson  [ROSS80].  At  present  there  is 
no  explanation  or  conjecture  as  to  whv  Jackson's  theorea  is  valid  for 
networks  with  feedback. 
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Although  it 


t  nee 


y  it  turned  out  that  steady-state 


equations  are  not  only  balanced,  but  that  : 

P(k1,...,kN)  -  Xj  P(k1.....ki-1 . kN) 


+  2  hj (kj+l-i^j)  P(k2,...,kj+1, 

J-l 


>kj— 1, ...  »k)|) , 


(5.20) 


Xi  P(k1#...,kN)  -  jj  |i£(k]+l)  ri0  P(k2 . ki+l,...,^)  .  (5.21) 

i-1  i-1 


These  eqnatioi 


illed  local  balance  equations  as  opposed  to  the 


steady-state  equations  which  are  often  referred  to  as  global  balance 
equations.  Local  balance  states  that  the  rate  of  flow  out  of  a  network 
state  due  to  a  custoaer  departing  a  queue  is  equal  to  the  rate  of  flow 
into  the  state  due  to  a  custoaer  arriving  at  the  queue.  Clearly  the  sua 
of  the  local  balance  equations  are  the  global  balance  equations.  Hence 
the  solution  to  the  local  balance  equations  satisfies  the  global 
balance  equations.  Local  balance  was  discovered  by  Whittle,  and  is  also 
referred  to  as  independent  balsnoe  [VHIT68]  [WHIT69].  As  an  ezanple  of 
looal  balance  and  its  use,  again  consider  the  network  in  Figure  5.4  . 


The  following  are  looal  balance  equations  that  correspond  to  the  global 
balanoe  equations  given  earlier: 

X  P(0,0)  -  r20  n2  P(0,1) 

X  P(1,0)  -  r2>0  n2  P(l.l) 

Pj  P(1,0)  -  X  P(0,0)  +  *2,1 


8 
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X  P<0,1)  -  r2  0  |ij  P(0.2) 
14  P(O.l)  -  14  P(l.O) 


X  P(2,0)  -  *2,0  *2  p<2»*> 
l»x  P(2,0)  -  X  P(l.O)  +  r21  |ij  P(l.l) 

X  P(0,2)  -  *2,0  *2  P(0*3) 

H2  P(0,2)  =  |»2  P(l»l) 

|i2  P(l.l)  -  X  P<0,1)  +  r2 fl  H2  P(0»2) 
l»2  P(l.l>  -  iij  P(2,0)  . 

There  ere  12  loeel  balance  equations  and  only  nine  unknowns,  therefore 
aone  of  the  equations  are  redundant.  The  following  ia  a  subset  of  the 
local  balance  equations: 

X  P<0,0)  -  x2,0  p2  p<°»1> 

X  P(0,1)  -  r2Q  jij  P(0,2) 

X  P<1,0)  -  *2,0  p2  p<1'1> 

Pi  P(2,0)  -  X  P(1,0)  +  *2,1  H 
lij  P(0,2)  -  P(l.l) 

X  P(2,0)  -  r2#0  |i2  P(2,l) 

X  P<1,1)  -  r2<Q  h2  P(l,2) 

X  P(0,2)  -  r2<0  42  p(0»3)  . 

Solving  these  equations  in  terns  of  P(0,0)  results  in  : 

P(0,1)  -  (X/r2>Q)  (1/ |i2 )  P<0,0) 

P(1.0)  -  (X/r2<0)  (1/41)  P(0,0) 


m 
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P<1.1)  -  U/r2>0)J 
P<2,0)  -  U/r2#0)2 
P(0#2)  -  <X/r2#0>2 
P(2,l)  -  U/»2#0>3 
PU.2)  -  (X/*2#0)3 
P(O.I)  -  U/r2#Q)3 


(1/pj)  (1/|»2)  P(O.O) 
(1/Hj)2  P<0,0) 

(l/gj)2  P(O.O) 

(1/dj)2  (l/gj)  P(O.O) 
(l/^2)  (l/gj)2  P(O.O) 
(l/gj)3  P(O.O)  . 


Tkt  fora  of  tki  solution  is  : 

Pt^.kj)  -  <X/r2#0)kl+k2  (l/g^1  (l/iaj)12  P(O.O)  . 

Which  agraas  with  tke  aolatioa  obtaiaad  earlier.  This  la  tka  only  known 
azaapla  of  a  queueing  network  (with  two  or  aora  service  cantara)  beiag 


solved  by  local  balaaea. 

It  ia  iaportaat  to  aota  tkat  to  akow  tkat  looal  balaaea  eziat 
Jackaoa'a  tkaoraa  vaa  aaad.  It  ia  alao  iaportaat  to  aapkaaiza  that 
looal  balaaoa  ia  aot  aaeaaaary  for  global  balaaea.  Tkat  ia  although  all 
quauaiag  network*  diaeuaaad  the*  far  hawa  looal  balance  othara  do  not. 
Local  balaaoa  ia  aa  iaportaat  tool  that  caa  ba  aaad  to  help  dateraina 
if  advanced  queueing  networks  have  a  product  fora  solution.  In  other 


words  one  can  assuae  looal  balaaea  and  if  the  looal  balance  aquations 
arc  oonaiatant  aa  aaawar  can  ba  obtained.  Tka  answer  can  then  be 
verified  and  used  to  prove  the  assuaptioa  was  true. 


5.3. 3  Aa  Application  of  an  Open  Queuelnz  Network 


An  azaapla  of  an  open  queueing  network  aodal  is  shown  in  Figure 
5.6  [FERR78].  The  nodal  represents  a  aaiafraae  coaputer  that  consists 
of  an  input/output  processor  (IOP),  a  ceatral  processing  unit  (CPU),  a 


Parameter  name 


Symbol 


Value 


Mean  arrival  rate 
Mean  input  service  time 
Mean  uninterrupted  CPU  time 
Mean  drum  service  time 
Mean  disk  service  time 
IOP  to  CPU  probability 
CPU  to  drum  probability 
CPU  to  disk  probability 
Drum  to  CPU  probability 
Disk  to  CPU  probability 
Disk  to  out  probability 


X 

0.7  jobs/s 

1/IM 

500ms 

l/*2 

30ms 

1/P, 

20ms 

1/P4 

80ms 

r12 

1.00 

r23 

0.75 

r24 

0.25 

r32 

1.00 

r42 

0.90 

r40 

0.10 

dm  processor,  tad  •  disk  processor.  Back  unit  is  assaaed  to  ooasist 
of  *  staple  strTir,  sad  tks  service  discipliae  is  sssaaed  to  be  FCFS. 
Psrsaetess  for  the  aodel  ere  givea  ia  table  S.l.  The  iapat  proeess  to 
the  eoapater  is  sssaaed  to  be  Poissoa.  All  jobs  are  sssaaed  to  be 
statistically  ideaticsl,  aad  all  service  tiaes  are  sssaaed  to  be 
expoaeatislly  distribated.  The  service  tiae  at  the  IOP  acooaats  for  the 
tiae  to  iapat  aad  load  a  job  iato  priaary  aeaory.  After  the  job  has 
beea  loaded  it  waits  its  tara  to  be  proeessed  by  the  CPU.  The  seen 
seraice  tiae  at  the  CPU  represeats  the  aeaa  tiae  before  the  job  seeds  a 
draa  or  disk  operatioa.  Beeaase  these  operatioas  are  slow  ooapared  to 
the  speed  of  the  CPU,  the  CPU  releases  the  job  to  the  draa  or  disk 
processor  aad  starta  oa  aaother  oae.  The  draa  aad  diak  seraice  tiaes 
represeat  typical  deaaads  aade  by  Jobs.  It  is  sssaaed  that  all  jobs 
that  reqaire  draa  operatioas  will  also  reqaire  aore  CPU  tiae  before 
coapletioa,  therefore  they  are  rooted  back  to  the  CPU.  Oa  the  other 
head  it  is  assaaed  that  oaly  90  perceat  of  the  jobs  that  reqaire  disk 
serwioe  will  reqaire  aore  CPU  tiae.  Two  siaplioatioas  hare  beea  aade 
that  wiolate  a  real  systea.  First  the  aodel  does  aot  take  ia  to  accoaat 
coateatioa  for  aeaory,  aad  secoad  a  Job  asaally  teraiaates  at  the  IOP 
so  that  its  oatpat  oaa  reach  the  ezteraal  world.  These  siaplicatioas 
are  aeoessary  ia  order  to  pet  aa  aaswer. 

Siace  there  is  oaly  oae  eatry  poiat  aad  oae  exit  poiat  the  aeaa 
throaghpat  rate  aast  eqaal  the  aeaa  arrival  rate.  This  is  aot,  however 
the  case  for  the  aeaa  respoase  or  taraaroaad  tiae  whose  calcolatioa 
will  be  oae  of  the  objectives.  Other  objectives  will  be  to  deteraiae 


v:v:scv 


Hi*  a**!!  nuaber  of  jobs  ia  the  network  is  therefor*  : 


L-Lj+Lj+Lj+I^-  7.78 


The  ae*n  response  tiae  can  now  be  calculated  by  applying  Little's  Law 


to  the  Network,  i.e. 


■  11.1  seconds/ job  . 


The  aaziaua  input  rate  can  be  deterained  froa  finding  the  ainiaua 


▼alue  of  X  that  oausea  one  of  the  unit  to  reach  100  percent 


utilisation.  In  teras  of  the  paraaeter  X  the  utilisations  are  : 


Pj,  **  0.5  X 
f>2  “  * 


0.6  X 


■  0.8  X  . 

Thus,  the  CPU  will  saturate  first.  Setting  p2  *4™!  one  and  solving 


for  X  results  in 


Xjjax  "  1/1.2  ■  0.833  jobs/s 


If  the  service  discipline  at  the  CPU  is  changed  to  processor  sharing. 


then  all  of  the  results  are  the  saae.  Although  true  this  stateaent  is 


soaewhat  aisleading.  The  problea  is  with  response  tiae.  The  aeans  are 


the  saae,  but  the  variance  distributions  are  different. 


I w 
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to  s  Dependent  on  the 


Custoners  in  the  Network 


Six  jeers  after  his  first  paper  Jackson  extended  the  class  of 
queueing  networks  that  could  be  solved  in  a  paper  that  is  considered 
the  classic  of  queueing  networks  [JACX63].  Again  he  considered  only 
networks  in  which  the  arrival  processes  fron  outside  the  systen  were 
Poisson  and  all  service  tines  were  exponentially  distributed.  However, 
he  allowed  the  mean  service  tine  at  each  server  center  to  vary  alnost 
arbitrarily  with  the  nunber  of  custoner  in  the  service  center,  and  he 
allowed  the  nean  arrival  rate  to  vary  according  to  the  nunber  of 
custoners  in  the  systen.  In  fact  the  arrival  rate  could  be  varied  such 
that  if  the  nunber  of  custoners  fell  below  sone  lower  Unit  then  a  new 
custoner  was  innediately  injected  into  the  systen.  Also  the  srrival 
rate  could  be  set  such  that  if  the  nunber  of  custoners  in  tho  systen 
reached  sone  upper  Unit  then  new  custoners  were  not  allowed  until  the 
nunber  fell  below  the  Unit.  By  setting  the  upper  and  lower  Units  at 
the  sane  value  he  considered  closed  queueing  networks.  The  following  is 
s  quote  that  appeared  near  the  end  of  the  paper  'The  discovery  of  these 
theorens  resulted  fron  naking  a  sequence  of  guesses  concerning  nore  and 
nore  general  jobshop-like  queueing  systens.  and  proving  successively 
nore  general  versions  of  the  theoren*. 

It  is  easier  to  handle  the  arrival  process  if  it  is  assuned  that 
all  arrivals  enanate  fron  a  single  Poisson  source  such  that  new 
custoners  are  routed  to  different  service  center  recording  to  fixed 
routing  probabilities.  Recall  that  if  a  Poisson  source  is  split  then 
the  resulting  processes  are  also  Poisson.  Therefore,  if  the  srrival 


process  Is  sot  a  function  of  the  nuaber  of  custoaers  is  the  system, 
then  it  is  equivalent  to  the  aultiple  Poisson  sources  in  Jackson's 
first  paper.  The  mean  arrival  rate  at  each  queue  can  not  be  deterained 
before  hand  if  the  arrival  rate  varies  according  to  the  nuaber  of 
custoaers  in  the  system.  However,  the  Bean  nuaber  of  visits  a  custoaer 
aakes  to  a  service  center  can  be  deterained.  Let  e^  represent  the  aean 
nuaber  of  tiaes  s  custoaer  visits  service  center  i.  Then 

•i“  r0i  +  ^  *J  rji  (5.22) 

j-1 

where  rQi  is  the  routing  probability  that  a  new  custoaer  eaanating  froa 

the  Poisson  source  visits  queue  i  first. 

Jackson  proves  in  his  paper  that  for  these  aore  general  networks 

of  Markovian  queues  that  the  joint  probability  distribution  also 

satisfies  product  fora.  More  precisely, 

X(S(H))  f^kj)  i2{^)  ”•  fN(kN) 

P(klt...,kN)  - - - -  (5.23) 

where 

ki 

*i(ki)  ■  n  «i/Pi(*> 

a-1 


K-l 


X(S(H)) 


.a u-’ 


N 


0  -  5  [x(S(D)  tilkj)] 

ell  feasible 
states 


H^(a)  ■  iiib  service  rat*  at  40*0*  i  whan  it  contain  'a'  cnstoaers 

aad 

X(a)  “  aean  arrival  rat*  *h*a  th*  network  ooataia*  'a*  oaatoaar. 

Th*  rol*  of  G  1*  that  of  a  aoraaliziag  ooastaat  to  iaaar*  that  tha 
probabiliti**  saa  to  oa*.  Of  coara*  there  ia  a  eolation  only  if  G 
converges  to  a  poaitive  naaber  less  than  iafiaity. 

Aa  aa  ezaaple  of  the  prodnct  fora  solation  consider  a  two  service 
center  network  with  the  following  paraaeters  : 

X(a)  »  m  /  (a+l)x  where  a>0  and  z^O 

|ij(a)  »  b  ay  where  b>0  and  y^O 

(i2<*)  “  c  »*  where  OO  and  z^O 

r01  "  r12  "  *20  “  1  tke  otker  rij  "  0  • 

Jackson's  theorea  states  that  the  joint  probability  distribation  for 

this  network  is  : 

(a/b)*1  (a/c)*2 

P(k1#k2)  -  -  * 

G(I)  ((kj+kj)!)*  (kx!)y  (kj!)1 

Hie  following  is  a  proof  of  Jackson's  theorea.  By  considering  all 
the  ways  in  which  state  (k^,k2»...»kg)  can  be  reached  the  set  of 
steady-state  equations  are  : 

[X«>  +  j|  Hitki)]  P(k  .....k  )  - 
i-1 


+  2  Mki+D  riO  P(ki»...»ki+l,...,kN) 
i-1 

♦  j|  j)  M- j (kj+l-S^j)  rj£  P(kj. . . .  ,kj+l, . . . .kj-l. . . . kfl) . 
i-1  j-1 

(5.24) 

Nov  the  following  relations  are  easily  aeen  froai  the  defining  equation 
for  P(k1#...,kN)  : 

P<*1 . *r*— -V  _  MV 

P(k1,...,ki.....kN)  "  ej  X(I-l) 

P(k~ .... ,k.+l, . . . ,kM)  e.  X(K) 

— _± -  .  -  (5.26) 

P(k1,...,ki.....kN)  l*1(k1+l) 

P(k. . k,+l . krl....,kN>  e.  W 

* _ i _ _ _ _  m  J  #  (5.27) 

P(k1,...,kj,  ...,ki#....kN)  et  ^(kj+l-ftjj) 

Dividing  both  sides  of  the  steady-state  equation  by  P(kj,...kN)  yields 

X(I)  +  j)  W  -  [ Mi (k^ )  tqj  /  e^]  +  ^  X(I)  e^  r*g 

i-1  i-1  i-1 


Substituting  rg* 


Mi<ki> 


eJ  rJ  i 


rj  i  *j  1  #i  • 


(5.28) 


into  the  first  suanation  on  the 


right  and  canceling  gives  : 


(5.29) 


X(l)  -  )  X(I)  9i  ri0  . 
i-1 

Substituting  definitions  of  eA  snd  r shows  thst  the  assuaed  solution 
bslsnees  the  steady-state  equations. 

Several  speoisl  esses  are  of  snffieient  interest  to  discnss  then 
separately. 


5.4.1  The  Constant  Arrival  Rate  Case 


If  the  arrival  rate  does  not  depend  on  the  nnaber  of  cnstoaers. 
then  for  all  'a*.  X(a)  -  X  -  constant  and  X(S(E))  -  XK_1.  For  this  case 
the  steady-state  probabilities  are 


P(lji ... .  hj^) 


f2(k2>  fN(kN> 


(5.30) 


where  Ii(h1),  K,  and  G  are  the  saae  as  before.  Multiplying  the 
nuaerstor  and  denoainator  by  X  and  letting  G  absorb  the  X  in  the 
denoainator  results  in 

[Xkl  W1  lX*2  f2(k2)]  **•  IxkN  W1 


Let  g£(kt)  -  X  fi(hi).  That  is. 


kA 

*i«i>  ■  n.  X  ei/|ti(a)  . 


In  teras  of  S^(ki)  the  stesdy-stste  probabilities  are 


Sl(kl)  *2^k2^  **•  ®N^kN^ 


Since  the  network  ie  open  ell  states  are  feasible  and 


■  m  m  m 

®  ■  5  5  “*  5  [  *l(kl)  *2<k2>  •••  «N<kN>] 

kl-°  kj-0  vo 

mm  m 

■  [ } ,i<ki)]  [  1  «“*>]  •••  1 5  ,nUn)]  •  <3'M> 

k1-0  kj-0  V° 

Notice  that  6  factors  into  tersis  where  eaeh  tern  involves  parameters 
for  a  single  service  oenter.  It  follows  that  P(k£,....kg)  factors  into 
terms  that  involve  a  single  service  center.  That  is 


P(ki . V  -  P1<k1>  P2<k2>  PN(kN> 


where  • 

Pi(ki)  -  gjCkp  /  J  *i(ki> 


(5.33) 


Thus,  the  distribution  of  customers  at  the  servioe  oenters  are 
independent,  and  the  distribution  at  eaeh  oenter  is  the  same  as  for  a 
one-service-center  queueing  system  where  customers  arrive  from  a 
Poisson  prooess  with  mean  rate  X  e^,  and  the  servioe  completion  process 
is  identical  to  that  of  service  oenter  i.  Also,  sinoe  e^  is  the  mean 
number  of  times  a  customer  visits  service  center  i.  it  follows  that  for 
this  oase  X  Sj  is  indeed  the  mean  arrival  rate  of  customers  to  center 
i.  Furthermore  if  center  i  contains  m^  servers  and 


kj  for  k^mj 

Fl(k1)  - 

•j  l»i  k^mj 

then  the  results  are  of  course  the  same  as  in  section  5.2. 


(5.36) 


126 


Vi  A  V-V.%  .V  A  A  -% 


A  closed  network  ie  one  in  whieh  the  nnaber  of  onstoaere  in  the 
network  reaains  oonetent.  Jeokeon  considered  dosed  networks  ss  s 
special  case  of  networks  in  whieh  the  arrival  rate  wariea  according  to 
the  nnaber  of  cnstoaers  in  the  network.  To  keep  the  nnaber  of  cnstoaers 
at  soae  constant  wains  I,  he  set  X(k)  ■  0  for  k^C  and  Thu*  if 
the  nnaber  of  cnstoaers  falls  below  K  a  new  enstoaer  is  iaaediately 
injected  into  the  network,  and  if  the  nnaber  of  cnstoaers  is  I.  new 
cnstoaers  cannot  enter  the  network.  This  is  equivalent  to  a  network  in 
which  the  saae  cnstoaers  circulate  eternally. 

Unaware  of  Jackson's  work  Gordon  and  Newell  published  a  paper  on 
closed  networks.  It  appeared  four  years  later  in  the  sane  periodical  in 
which  Jackson's  paper  appeared  [GOKD67].  They  acknowledged  later  that 
their  foranlae  for  steady-state  probabilities  conld  be  obtained  by 
specialising  the  paraaeters  of  Jackson's  aore  general  aodel.  However, 
researchers  at  the  tiae  were  unaware  of  this  and  treated  Gordon  and 
Newell's  siaplified  notation  and  results  ss  independent  work.  Even 
today  credit  is  aore  often  given  to  Gordon  and  Newell. 

The  approaoh  need  here  is  siailar  to  that  nsed  by  Jackson.  For  a 
closed  network  X(S(K))  is  assigned  the  value  of  one,  and  since  r^Q 
equals  xero  for  all  i. 


j-1 


By  considering  all  the  ways  in  which  state  (k^,k2,...,k^)  csn  be 
reaohed  the  steady-state  equation  is 


2  Pi<ki>  P(ki....#kN>  “ 
i-1 

i-1  j-1 


Proa  tbs  defining  equation 


•i  »tj<kj+1'6lj> 


Dividing  both  aides  by  POtj.....^)  reanlta  in 


^  Pi<ki>  -  jf  Pi<ki>  rji  «j  /  *£  . 


i-1  j-1 


(5.40) 


Using  the  definition  of  et  or  aore  precisely  the  fact  that 


[rji  ej  /  ej]  -  1 


(5.41) 


shovs  the  equation  is  balanoed.  Hence  the  solution  satisfies  the 
steady-state  equations. 

Again  not  only  are  the  steady-state  equations  balanced,  but  it 
turns  out  that 

Pi<ki>  P(k1.....kN)  - 

>  **j  (kj+l-ftij)  rji  P(k1,....kj+l,....ki-l,...,kN)  . 

J-1 

(5.42) 

The  iaplication  is  that  looal  balance  also  applies  to  closed  networks. 


•  j'kvvv-vv.  vv.Vj,"',  .**  <■’  «■"  -« 


Notice  that  if  all  of  the  e's  are  aultiplied  by  a  constant,  then 
the  eet  of  N  equations  defining  thea  is  still  satisfied.  Hence,  for  a 
closed  network  there  are  only  N-l  independent  equations.  The  solution 
is  to  assign  one  of  the  e's  an  arbitrary  positive  value.  Only  their 
ratios  appeared  in  the  proof.  The  e's  in  a  dosed  network  are  often 
referred  to  as  relative  throughputs. 

Although  froa  a  theoretical  point  of  view  any  positive  value  can 
be  assigned  to  one  of  the  e's.  The  vslue  selected  does  affect  the 
noraalising  constant,  6,  and  oan  cause  nuaerical  probleas  such  as 
overflow  or  underflow.  Coapensating  for  the  fact  that  the  aagnitudes 
are  not  know  is  only  one  of  the  purposes  of  the  noraalising  constant. 
It  would  still  be  required  even  if  the  aagnitudes  were  known  before 
hand.  The  noraalising  constant,  0,  is  virtually  a  function  of  every 
paraaeter  in  the  network. 

It  is  reaarkable  that  joint  probability  distribution  of  s  closed 
network  of  queues  with  exponential  servers  has  a  product  fora  solution. 
That  is,  the  fora  of  the  solution  is  the  product  of  N  queues  with 
Poisson  arrivals  and  exponential  servers,  divided  by  a  noraalising 
constant.  Vhat  aakes  this  so  reaarkable  is  that  none  of  the  arrival 
processes  are  Poisson  at  any  service  center.  Agsin  no  one  has  an 
explanation  of  why  this  is  so. 

Even  though  the  solution  has  s  product  fora  the  distributions  at 
the  individual  service  centers  are  not  independent  since  their  sua  aust 
always  equal  the  saae  value.  This  is  the  priasry  reason  that  a  closed 
fora  solution  for  the  noraalising  constant  oan  not  be  obtained. 
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Determining  the  normalizing  constant  by  the  obvious  way  of  finding  all 


of  the  nnnoraalized  probabilities  oan  be  and  nasally  is  a  difficult 


problem.  By  considering  the  nnmber  of  possible  ways  that  cnstoaera  can 


be  distributed  in  a  closed  network  the  number  of  states  oan  be 


determined.  This  problem  is  equivalent  to  that  of  finding  the  number  of 


permutations  of  N-l+f  objects  of  which  N-l  are  the  same  and  K  are  the 


same.  Thus  for  a  closed  netvorh  with  N  service  oentera  and  K  customers 


the  number  of  states  is 


■±  I  -  ill  m  I*  +  S(I)  -  l\ 
-  1)1  I!  \  N-l  J 


(5.43) 


For  example  for  a  network  with  t  eight  servioe  centers  and  20  customer 


there  are  888,030  states.  Fortunately  other  techniques  to  determine  the 


normalising  constant  exist.  One  of  these  will  be  discussed  in  detail  in 


Chapter  7. 


As  an  example  of  a  closed  network  consider  the  model  in  Figure 


5.7.  Again  assume  that  eaoh  service  center  has  a  single  server,  and 


that  all  jobs  are  statistically  identical,  and  that  all  service  times 


are  exponentially  distributed.  The  parameters  for  the  network  are  given 


in  table  5.2.  A  job  making  a  CPU  to  CPU  transition  is  regarded  as 


having  left  the  system  and  having  been  immediately  replaced  by  another 


job.  Thus,  the  flow  along  the  CPU  to  CPU  path  represents  the  system 


throughput.  The  objective  is  to  determine  the  mean  number  of  customers 


at  eaoh  servioe  center,  the  utilization  of  each  service  center,  the 


mean  throughput,  and  mean  response  or  turnaround  time  of  a  job.  To  make 


m 

I 

& 


$ 

& 


the  problea  manageable  aaanae  that  the  number  of  joba  in  the  system  is 
three. 

Sinee  there  are  three  service  centers  and  three  jobs  in  the 
network  the  total  number  of  network  states  is 


(*  *  3  -  l\«  -JJ _ 
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The  state-transition-rate  diagram  for  this  network  is  depicted  in 
Figure  5.8.  The  ten  steady-state  or  global  balance  equations  are: 

14  P(3,0,0)  -  14  rn  P(3,0,0)  +  p2  Pd,  1,0)  +  p3  P(2,0.1) 

[14+14]  Pd. 0,1)  -  |ax  rn  Pd. 0.1)  +  p2  r13  P(3.0,0) 

+  14  P(l.l.l)  +  p3  P(l,0,2) 

[pj+pj]  P(2, 1,0)  -  p2  rn  P(2,l,0)  +  px  r12  P(3.0,0) 

+  p2  P(l.l.l)  ♦  p3  P(l. 2,0) 

[p^pj]  P(l. 0,2)  -  p2  r21  P(l. 0.2)  +  p2  r13  P(2,0,l) 

+  p2  P(0,l,2)  +  p3  P(0,0,3) 

[p2+P2+P3]  P(l. 1,1)  -  P2  r12  P(l.l.l)  +  P2  r12  P(2,0,l) 

+  p2  r13  P(2,l,0)  +  p2  P(0,2,l)  +  p3  P(0,l,2) 

[p2+P2l  P(l,2,0)  ■  p2  r^2  P(l,2,0)  +  Pj  r22  P(2,l,0) 

+  p2  P(0,3,0)  +  p3  P(0,2,l) 

p3  P(0,0,3)  -  p2  r13  P(l, 0,2) 

[p2+p3]  P(0,l,2)  -  p2  r12  P(l, 0.2)  +  p2  r13  P(l.l.l) 

(p2+P3I  P(0,2,l)  ■  p^r12  Pd. 1,1)  *  Pi*i3  P(l»2.0) 
p2  P(0,3,0)  -  p2r12  P(l, 2,0)  . 
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Of  course  the  steady-state  probabilities  could  be  determined  by  solving 
these  ten  sianltsneons  equations.  Another  approach  would  be  to  write 
loeal  balanoe  equations  and  solve  these.  For  example  the  looal  balance 
equations  corresponding  to  the  fifth  global  balance  equation  are: 

P2  P(l.l.l)  -  |ix  rn  P(l.l.l)  +  p2  P(0,2, 1)  +  p3  P(0,1 ,2) 

1»2  P(l.l.l)  -  p2  r12  P(2,0,l) 

P3  PCI. 1.1)  -  p2  r13  P(2«l«0)  . 

Neither  of  these  approaches  will  be  used  here.  The  method  described  by 
Jackson  will  be  used  instead. 

The  equations  describing  the  mean  number  of  times  a  job  visits  a 
service  oenter  are  : 

e2  -  0.1  e2  +  e2  +  e3 
e2  ”  0.8  e2 
e3  ”  0.1  e2  . 

Observe  that  there  axe  only  two  independence  equations.  Although  any 
positive  value  can  be  assigned  to  one  of  the  e's,  assigning  100  to  e^ 
causes  the  ratio  of  *1/14  to  be  integers.  Selecting  e2  as  100  results 
in  : 


-  100 

and 

e2/pi 

-  80 

and 

e2/p2 

-  10 

and 

93/fl3 

KmwhQM  1(0®  EH  5  ski  5  maxRnnn 

^CTyi,iVWlMViWyi.*<i 
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The  joint  probability  distribution  that  service  center  one  contains 
kj  jobs,  service  center  tvo  k2  jobs,  and  service  oenter  three  kg  jobs 

is 


P(kl'*2'k3> 


fl(kl>  f2(k2>  f3<k3> 
G 


where 


(•i/|»i)ki  • 


Hence,  Pdc^kj.kg)  • 


(•l/|»l>kl  (ej/pj)*12  (e3/|i3)k3 

_ 


The  ten  steady-state  probabilities  are  therefore: 

P(l,l,l)  -  2/6 
P(l,0,2)  -  1/6 
P(2,0,l>  -  1/6 
P(0,l,2)  -  2/6 
P<0.0,3)  -  1/6 
P(0,2,l)  -  4/6 
P(2,l,0)  -  1/6 
P(3,0,0)  -  1/0 
P(l,2,0)  -  4/G 
P(0, 3 ,0)  -  8/G  . 

The  noraalising  constant  is  deternine  fro*  the  fact  the  the 
probabilities  anst  sna  to  one.  More  precisely, 

J  PCki.kj.kj)  -  26/G  -  1  . 

all  states 


Hence,  G  ■  26.  The  aean  queue  length  at  each  service  center  is 


P3(0)  -  P(2,l,0)  +  P(3,0,0)  +  P(l,2,0)  +  P(0,3,0) 


-  (2  +  1  +  4  +  *>  /  26  -  0.577  . 

The  utilization  at  th«  thraa  service  centers  is  : 

px  -  1  -  P1(0)  -  0.423 
p2  -  1  -  P2(0)  -  0. 846 
P3  -  1  -  P3(0)  -  0.423  . 

The  throughput  of  the  systea  can  be  deterained  froa  the 
utilization  and  aean  service  tiae  at  service  center  one.  If  the  service 
center  one  was  busy  100  percent  of  the  tiae  the  nnaber  of  cnstoaer 
served  per  second  would  be  l/10as,  or  100  jobs  per  second.  Utilisation 
equals  the  long  run  percent  that  the  service  center  is  busy.  Henee  the 
nuaber  of  jobs  passing  through  servioe  center  one  is  0.423  z  100  -  42.3 
jobs/s.  The  probability  that  a  Job  aakee  a  CPU  to  CPU  transition  is 
0.1.  therefore  the  nuaber  of  oustoaer  coapleting  service  (the 
throughput)  is  4.23  jobs/s.  The  aean  response  tiae  can  be  deteraine  by 
applying  Little's  Lav  to  the  network.  That  is, 

L  3 

R  ■  -  -  — — -  -  0.798  seconds  per  job. 

T  4.23 


5.5.4  Open  Networks  with  Finite  Storage  Capacity 

Although  the  fora  of  the  solution  for  a  systea  with  arrival  rates 
dependent  on  the  nuaber  of  custoaers  in  the  network  was  given  in 
section  5.5,  the  nornalizing  constant  is  nezt  to  inpossible  to 
deteraine  unless  there  ezists  a  positive  integer  I*  such  that  X(I)  * 
X(K*)  for  K2.Z*'  The  aost  interesting  oase  is  when  X(I*)  “  0.  This  is 
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because  almost  all  real  systems  cam  contain  only  a  finite  number  of 
customer.  Customers  that  arrive  when  tbe  system  is  full  are  simply 
turned  away  without  receiving  service.  A  common  example  of  this  is  the 
telephone  system.  In  fact  it  was  the  study  of  this  system  that  brought 
about  the  birth  of  queueing  theory. 

A  queueing  network  with  finite  storage  capacity  is  equivalent  to  a 
closed  network  with  K*  customers.  The  sources  and  sinks  in  the  original 
network  are  replaced  by  a  service  center  with  rate  p(k)»A(I*-k).  Since 
the  interdeparture  process  (time  between  departures)  of  this  service 
center  is  the  same  as  the  interarrival  process  (time  between  arrivals) 
of  the  original  network,  the  two  networks  are  equivalent.  This  is  best 
illustrated  by  example.  The  network  in  Figure  5.9  is  equivalent  to  a 
single  service  center  with  Poisson  arrival  rate  and  finite  storage 
capacity  K*.  To  see  this  first  reoall  that  the  steady-state  solution  is 
invariant  to  the  initial  distribution  of  customers.  Nov  assume  that  all 
K*  customers  are  initially  at  the  first  service  center.  As  long  as 
there  sre  customers  st  this  service  center  the  departure  process  is 


K*  CUSTOMERS 


Figure  S.9  Equivalent  M/M/l/K*  System. 
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exponentially  distributed  with  nesn  pj.  Now  sinoe  the  departure  prooea* 
at  the  first  serwioe  center  is  the  arrival  prooess  at  the  second 
service  center*  it  follows  that  the  arrival  process  is  Poisson  with 
aiean  rate* 


Kk* ) 


for  kj<I 
for  kj-K* 


Vhich  is  identical  to 


•  C: 


f  p,  for  k,>0 
Pitkj)  -  X(I  -1^)  -  1 

L  0  for  kj-0  . 

Hence  the  first  service  oenter  controls  the  arrival  process  to  the 
second  service  center*  and  the  network  is  equivalent  to  the  M/M/l/K* 
systea.  Note  that  in  this  exaaple. 

A  aore  aatheaatical  proof  that  the  two  systeas  are  the  equivalent 
consists  of  showing  that  the  probability  distribution  of  custoaers  is 
the  saae.  More  precisely. 


[J-f1 

rjLf2 

r  J_f  f 

-1 

1  P2J 

L  p2J 

L  p2J  L 

P(k2)  -  P(k1#k2)  - 


Solving  for  the  noraalizing  constant  yields: 

5*  •  k. 

0  -  )  (l/pi)1*  (pi/p2>  ‘ 

k^O 


fil 

f  H“(P1/P2> J 

L  pj- 

Cl— <Pv/p2) ] 

Thus 


(li./p-)*2  Cl-(|i*/|i2> 3 

—  P(k2,  -  -J-J - i-L-  . 

Cl-<H1/H2>3K  +1 

whioh  it  identical  of  that  for  the  M/M/l/K*  systea  with  and  k-kj. 

An  sxaaple  where  the  onatoaer  population  it  finite  and  the  arrival 
rate  varies  according  to  the  nnaber  of  cnatoaera  at  the  systea  it  the 
M/M/1//N  systea  (Chapter  3,  Section  3.8).  Ike  systea  is  equivalent  to 
the  network  in  Figure  5.10.  Recall  that  for  this  systea  the  arrival 


M  CUSTOMERS 


iqaiulntlj 


H1(k1)-X(l(-k1) 


for  kj>0 


for  kj-0  . 


Not*  that  in  ordor  to  show  that  the  probability  distributions  are  the 
sane  M  was  not  replaoed  by  K*.  It  follow  that: 


j_  r  j-f1  lli*2  _l  [j_f  f!il 

kj !  L  Iijj  L  Jijj  (M-kj)!  L  tijJ  LjijJ 


P(kj)  -  PCkj,^)  - 


and 


[l/<M-k2)M  (I/pi)11  (m/i^)*2 


kj-0 


-  U/n)*  *  U/0*-k2)!]  (n/l^)*2  » 

ka-° 

and  finally 

m  [-if2 

(M-k^l  lp2J 

Kkj)  -  -  ' 

J  INI / (M-k2) ! ]  (Hi/k2)k2 

kj-0 

which  is  the  sane  as  the  M/M/1//N  systea  with  X-iij  sad  k-kj. 

In  general  any  network  with  finite  storage  capacity  can  be  napped 
by  this  procednr*  into  an  equivalent  closed  network. 


For  i  nbiit  of  the  servioe  centers  the  servioe  rate  a  ay  be  a 
fnnotion  of  both  the  nnaber  of  customers  is  the  service  oenter  and  the 


nnaber  in  the  subset  [BASK75].  The  following  asssaes  the  service 
oenters  are  nnabered  snoh  that  1,2,.... M  are  in  the  subset.  Let  t|  be 
the  nnaber  of  onstoaers  in  the  subset  and  let  Z|(Kj)  be  a  positive 
fnnotion  snoh  that  the  servioe  rate  of  the  centers  in  the  subset  is 
Zj(Ij).  For  this  case  the  joint  distribution  is  the  saae  as 
before  except 

M  M  w 

II  £i(ki>  n  *i<ki>  n  «/*iCd»  »  (5.44) 

i-1  i-1  a-1 

where  the  symbol  :»  is  an  assignaent  operator  and  is  read  as  ’becoaes’. 

Sinoe  this  will  be  used  later,  and  since  it  is  not  known  to  be 
proved  elsewhere,  it  will  be  proved  here.  By  considering  all  the  ways 
in  which  state  <k1,k2,...,kN>  aay  be  reached  the  steady-state  equation 

is: 


fx(K)  +  )  Hi(ki)  ZI(kI) 
i-1 


kN>  - 


♦  2  Hi(ki+1)  Zj(ki+1)  r^o  P(k1,...,ki+l,...,kN) 
i-1  *  _ 


± 


*  7  riO  P(ki»...»ki+l#...»kj|) 


+  5  5  Pj(kj+1“»ij)  zI<kl)  *ji  p(ki,...,kj+l,...,ki-l, 

i-1  j-1 


i-M+1  j-1 

l 

i-l  j-B+i 


l»j(kj+l)  Zjtkj+l)  tji  P(k1,...,kj+1 . k£-l. 


Pj^kj+1^  rji  P(kl»«..#kj+l»...»k£-l,...,kN) 


+  ^  ^  Pj^kj+1“4ij^  rji  P(ki,...,kj+l,...,k£-l,^.  .,kN) 

i-1+1  j-M+1 


The  following  relations  are  froa  the  defining  equation  of  P(k^,. 

for  i^M 


P(k1#... 

.ki-l. 

•  •  • » kfj) 

Hj(kj)  Zj(ij) 

P(ki... 

• » ki»  • 

...kN) 

«£  1(1-1)) 

Pfkj.... 

.fcg-l. 

•  •  • » kj|) 

Hi(ki) 

P(kj... 

•  »ki*  • 

•  *  *kjq) 

et  1(1-1)) 

P(k1#... 

.ki+l. 

•  •  •  »  k>|) 

e£  1(1) 

for  i>M 


P<k, 


Hl(ki+1)  ZI(kI+l) 


ki* . . .  #kjj) 


for  i^M 


*»,  «». 


Coabining  th«  third  and  fourth,  fifth  and  seventh,  sixth  and  eighth. 


teraa  on  the  night  yield*: 


X(K)  +  )  mtti)  Zl<kl)  +  >  H0*1  " 
i-1  i-I+1 


♦  )  8i(ki>  Zi(kj)  r0i  I  *i  +  /  r0i  !  #i 

i-1  i-I+1 


+  )  X(K)  ri0  et 
i-1 


+  2  2  *i<ki>  ZI<kI>  rji  *j  f  *i  +  /  2  rJ*  *j  /  *i  * 

i-1  j-1  i-I+1  J-l 

(5.48) 


Substituting  rQi  ■  ^  *j  rji  7^*^*  : 

j-l 


X(I)  +  2  l»i(ki)  Zl(ki)  ♦  2  Hi<ki> 

i-1  i-I+1 


♦  >  zi(ki>  "/  2  •‘izi<ki)  rji  *j  1  *i 

i-1  i-1  j-l 


♦  5  Hi<ki>  "  2  \  !*i<ki>  rji  *j  1  *i 

i-I+1  i-I+1  j-l 


+  2  Kw  ^io  *i 

i-1 


+  )  -S  Zl(ki)  rji  •}  /  #i  +  /  /  rji  ej  1  *i 

i-«+i  j-i 

(5.49) 


or  aqninltatlf, 


X(K)  +  }  Hi(ki)  Z i(*i)  +  )  Hidti)  - 
i-1  i-B+1 


+  2  k<*>  rio  *i  +  2  ***<ki*  Zi(ki>  +  2  l‘1*kl) 

i-1  i-1  i-1+1 


(5.50) 


Filially  substituting 


-  j)  rtj  and  et  -  r0i  +  J  aj  rJt 


balances  the  aquation. 


In  tlia  nazt  chapter  nora  advanced  natvorks  will  ba  covered. 
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CHAPTER  6 


ADVANCED  QUEUEING  NETWORKS 

6.1  Custoaer  Clu»«« 

In  the  queueing  networks  discussed  in  the  lsst  chapter,  it  was 
assnsied  that  all  oustoners  at  a  service  center  were  identicsl.  The 
usual  way  to  eliainate  this  assuaption  is  to  partition  the  oustoners  at 
a  service  center  into  classes.  Within  a  class  all  oustoners  sre 
hoaogeneous,  but  different  classes  aay  have  different  service  tiae 
distributions,  priorities*  routing,  etc.  It  is  iaportant  to  eaphasize 
that  classes  are  sssooiated  with  serviee  centers,  snd  that  custoaers 
are  distinguished  at  the  service  center  level.  This  is  aore  general  and  - 
includes  the  case  in  which  oustoners  are  distinguished  at  the  network 
level.  For  exaaple,  all  oustoners  entering  a  network  aay  be  identical, 
whereas  a  customer  visiting  a  service  center  for  the  second  tiae  asy 
have  a  different  service  tiae  distribution  and  routing  probabilities 
than  a  custoaer  that  is  visiting  the  sane  service  center  for  the  first 
tiae.  Thus,  at  the  service  center  level  the  two  custoaers  behsve 
differently. 

The  notation  used  in  the  last  chapter  is  easily  extended  to 
include  classes.  A  custoaer  st  servioe  center  i  in  clsss  s,  sfter 
receiving  service,  proceeds  to  service  center  j  clsss  t  scoording  to 
the  routing  probability  ri#Jjt.  The  aean  servioe  tiae  of  s  custoaer  st 
service  center  j  in  olass  t  is  denoted  |ijt. 

Figure  5.1  shows  a  closed  network  with  two  service  centers  snd 
three  classes.  Service  center  two  is  represented  by  s  service  facility 


with  two  queue*,  oae  for  eteh  class.  This  depicts  the  situation  where 
•errioe  tin*.  distribatioas  aad  rout in*  a  ay  be  differeat  for  differeat 
elesses.  Ia  reality  there  is  oaly  oae  queue  at  service  eeater  two. 


Figure  (.1  Network  with  Two  Service  Ceaters  sad  Three  Classes. 

Figure  6.2  shows  a  cloaed  network  with  two  routiag  chains.  The 
routing  probabilities  are  suoh  that  a  customer  in  the  top  chain  (loop) 
cannot  aake  a  transition  to  a  class  ia  the  bottoa  chain.  The  sane  is 
true  of  custoaers  ia  the  bottoa  chain.  Heaee,  the  number  of  customers 
in  the  top  aad  bottoa  chains  are  both  constants.  Usually,  custoaers  in 
different  routing  chains  are  distinguishable  at  the  network  level. 


CHAIN  1 


Figure  (.3  deplete  ea  open  network  with  two  rooting  chains.  The 
nuaber  of  eistoaers  in  each  chain  ia  a  randoa  variable.  It  ia  aaauaed 
that  both  aonreee  are  Poisaon.  However  the  aean  arrival  rate  of 
cnstoaera  froa  source  one  aay  depend  on  the  noaber  of  oostoaers  in 
chain  one  (the  top  chain).  The  sane  applies  to  the  aean  arrival  rate  of 
oostoaers  froa  sooree  two.  If  the  aean  arrival  rates  are  constant, 
which  is  the  osoal  case,  then  the  sources  can  be  coabined  into  a  single 
Poisson  source,  and  the  network  reduces  to  a  single  chain.  In 
foraulating  open  queueing  network  models,  it  is  often  convenient  to 
assuae  that  there  are  aultiple  routing  chains.  However,  for 
coaputational  purposes,  it  is  desirable  to  have  only  one  chain.  It  is 
also  true  that  if  classes  are  used  only  for  routing  purposes,  then 
generally,  the  nuaber  of  classes  required  can  be  reduced  by  conbining 
the  sources. 


SOURCE  1  CLASS  1  CLASS  1  CENTER  2 


Figure  6.3  An  Open  Network  with  Two  Chains. 

Figure  6.4  depicts  a  aired  network.  The  network  is  a  combination 
of  an  open  and  closed  network.  The  nuaber  of  oostoaers  in  the  top  chain 
is  a  randoa  variable,  whereas  the  nuaber  of  custoaers  in  the  bottom 


chain  is  constant. 


CENTER  1  CENTER  2 


Figure  6.4  Mixed  Network  with  Two  Chains. 

6.2  Nonexponential  Service  Tinea 

Another  limitation  of  the  qneneing  networks  in  the  preceding  ~ 
chapter  was  that  all  aerwioe  tiaea  had  to  be  exponentially  distributed. 
The  only  approach  for  dealing  with  nonexponential  aerwioe  tiaes  is  to 
represent  thea  by  a  coabination  of  series  and  parallel  stages  in  which 
the  tiae  spent  in  each  stage  is  an  independent  randoa  variable  that  is 
exponentially  distributed.  The  necessary  condition  to  accoaplish  this 
is  usually  stated  as  :  the  probability  distribution  function  aust  have 
a  rational  Laplaee  transfora  (oan  be  expressed  as  the  ratio  of  two 
polynoaials  in  s)  [BASK7S]  [KLEX76]  [I0BA81]  [HAYE84].  This  statement 
is  conditionally  correct,  however,  in  order  for  the  probability 
distribution  function  to  have  a  rational  Laplace  transform  it  is 
necessary  that  the  probability  density  function  have  one  also.  More 
precisely. 


b  (a)  ■  Laplace  transform  of  tbe  density  function, 

B*(s)  ■  Laplace  transforn  of  tbe  distribution  function, 

and 

B(0~)  «  Tbe  distribution  function  evaluated  at  0”. 

The  reason  for  attaching  such  significance  to  this  point,  is  that  there 
are  no  examples  in  the  literature,  and  the  statement  leads  one  to 
believe  that  it  is  the  distribution  function  that  is  expanded  to  obtain 
the  stages,  when  in  fact  it  is  the  density  function.  The  crucial  point 
is  that  the  joint  density  function  of  the  sun  of  two  independent  randon 
variables  is  the  convolution  of  the  individual  density  functions,  and 
therefore  the  Laplace  transform  of  the  joint  density  function  is  the 
product  of  the  individual  transforms. 

The  procedure  then  consists  of  taking  the  Laplace  transform  of  the 
density  function  and  expanding  it  into  a  series  of  exponential  stages. 
The  obvious  way  to  perform  the  expansion  is  to  use  the  method  of 
ordinary  partial  fraction  expansion.  However,  this  does  not  yield  the 
minimum  number  of  stages,  and  the  computation  complexity  rises  rapidly 
with  eaoh  stage.  Although  it  may  not  be  well  known,  there  are  several 
versions  of  partial  fractions  [COZ55].  Any  density  function  that  has  a 
rational  Laplace  transform  can  be  expanded  in  the  following  fora  : 

b*(s)  -  bQ  +  ^  a0...aj_1bj  p1/(s^|ii)  (6.2) 

where  z  is  the  order  of  the  denominator,  and  a^+b^l, 

for  i«*0,l,...,z~l  and  b  ■!.  The  structure  of  the  representation  that 


of  stages  always  equals  the  order  of  the  denoainator.  Therefore,  when 
there  are  repeated  roots,  it  results  in  fewer  exponential  stages  than 
would  ordinary  partial  fractions  . 


Figure  6.5  Cox's  Method  of  Exponential  Stages. 


Then  a  custoaer  arrives  at  a  service  facility  of  the  type  in 
Figure  6.5,  he  has  a  fixed  probability  bQ  of  iaaediately  leaving  the 
facility,  experiencing  a  zero  length  service  tine.  On  the  other  hand, 
there  is  a  fixed  probability  Sq  that  he  will  enter  the  service 
facility.  If  he  eaters,  then  he  iaaediately  proceeds  to  stage  one.  The 
service  rate  at  this  stage  is  the  aean  service  tiae  1/p^.  Upon 
coapleting  servioe  at  stage  one  tje  custoaer  proceeds  to  stage  two 
according  to  probability  a^,  or  exits  the  facility  according  to 
probability  bj.  If  a  oustoaer  reaches  the  last  stage,  then  after 
receiving  service  he  exits  the  facility.  The  aean  service  tiae  of  a 
custoaer  is  the  weighted  sua  of  the  aean  tiae  spent  in  each  stage.  More 


precisely 


E<*>  -  t1*0<l-»l>  +  [%♦  ij]  +  [is  Jj+  i3]  «0*l*2<l-»3> 

+  ***"+  [is  V  ***  +  K]  *0*1*2« • ••u-1  .  (6.3) 


A  little  arithmetic  shows  that 


*0  *0*1  *0*1*2 

E(t)  -  —  +  -  +  -  + 

“1  **2  “3 


*0*1*2*  “*n-l 


(6.4) 


Equation  (6.4)  ia  very  naafnl  in  deriving  marginal  steady-state 
probabilitiea.  It  doe a  not  appear  elsewhere  in  the  literature  nor  does 
the  equation  that  precedes  it. 

In  order  to  illustrate  the  procedure  assnsie  that  the  Laplace 
transfora  of  the  density  function  is 


b*(  s) 


a3  ♦  Is2  +  22s  ♦  16 
4(e3  +  5a2  ♦  Sa  +4) 


Expanding  this  function  according  to  Equation  6.1  results  ia 


.  e.  .  1  3s*  +  14a  +  12 

b  (a)  -  -  +  - - - 

4  4  (a+2)2  (s+l) 


1  A  B  C 

■  —  +  — -  +  -  ♦  - 

4  a+2  (s+2)2  ( a+2 ) 2 ( a+l ) 


13  3  1 

_  +  - -  ♦  -  ♦  - 

4  4(a+2)  4 (a+2) 2  4(a+2)2(s+l) 


Vy  HUti*!  llki  iMffitiiiti  tk*  u4  »'i  tu  k«  4otoralao4,  i.« 


k)  ■  1/4  »o*1-  1/®  •(•jlj"  S/1#  *0*^*2  ■  1/1#  ( 

•a#  tht  nitlti  »rt 

•0*1/4,  *2*1/2.  *2*l/<. 

#0-1/4,  #|*l/2«  #2-S/#. 

Tk*  oorrotg oa41ag  rog r****t*ti**  of  th*  ooroioo  tia*  it  4*fi«t*4  ia 
Figaro  #.#. 


Figaro  #.#  laaagio  of  Coa'o  Motko4  of  Bayaaoatial  Itagoo. 


A  goo4  okook  io  to  ooaforo  t#o  ao*a  oorvioo  tiao  o*loaloto4  froa 
tko  origiaal  Aoaoity  faaotloa  oitk  tkot  giro*  #y  M*otl«*  (#.4).  Tkio 
«••  #o  aoooaplloka#  oil#  tko  ogaot loa: 


Kt] 


(•) 


4o 


<4.  S> 


(KLXJ7S).  Tkio  o*aatioa  ko!4o  for  oay  4oaoity  faaotloa  o*4  folloao  froa 
tko  f*ot  tkat  tko  oaatiaaaao  tiao.  aoaoot  goaorotiag  faaottoo  oa4  tko 
Laglaoo  traaofora  of  tko  Aoaolty  faaotloa  4tffor  oaly  t*  tkot  tko  lira 
o'*  agpoaro  la  tko  foraor  oa4  o’"  to  tko  lottor. 


Coatiaaiag 


lit]  - 


r4(a*+3a2»ta+4)(3s2+14a»12)  ~  4(a3»ta2»22a-H4)(3o2+10a»t)1 


l4(a2+3a2+la+4) ]2 


H) 


-  J/4 

a  ad  froa  I^matioa  (4.4) 


Bit] 


3/4  +  (3/4) (1/2)  +  (3/4) (1/2) (1/4) 
1*1  *  1 


5/«  . 


Is  tkia  mayl*  all  of  th«  polos  of  tko  Laplaoo  traasfora  sro 
loosto4  oa  tko  aogatioo  roal  axia.  lovotov  if  tko  atraotaro  ia  goiai  to 
ko  appl io4  to  aay  ioaaity  faaotioa  of  a  aoaaogatito  raadoa  Tariablo. 
tkoa  tko  poloo  aay  oooar  aayvkoro  ia  loft-kalf  plaao.  Tki  a  iaplioa  tkat 
tko  tiao  apoat  ia  a  atago  aay  ko  a  ooaplox  aaakor,  aad  tkat  tko 
prokakility  of  aakiag  a  txaaaitioa  oat  of  tkie  atago  ia  aa 
iaf iaitoaiaal  aaoaat  of  tiao  ia  also  ooaplox.  All  of  tkio  loads  to  tko 
coaolaoioa  tkat  tko  aiaplo  liaoar  kalaaoo  ogaatioaa  of  tko  prooodiag 
ckaptor  Mt  koooao  ooaplox  ogaatioaa  vitk  ooaplox  prokakilitioa.  Tko 
iatorprotatioa  ia  tkat  tko  atagoo  aro  paroly  artificial.  Tkoy  aro  oaly 
iatrodaood  ao  a  aatkoaat  ioal  tool  for  tko  r opto aoat a t i oa  of 


aooospoaoatial  ooraioo  tiaoa.  Tkoao  fasts  aay  ko  diatsrktag  kat  tkoy 
ahoald  aot  ko.  Tkoy  aro  osastly  tko  saao  priaoiploa  tkot  aro  asod  ia 
ciraait  aaalysia.  Tkoro  aro  ao  aoaploa  voltagoa  sad  oarroats  ia  aa 


olostrloal  aotoork.  Coaploa  aaakors  aro  iatrodaood  aololy  for  tko 


yarpooo  of  aaalyaia.  At  tko  sad  of  tko  oaalyois  oil  of  tko  rosalts  aro 
root.  Tko  aoao  ia  trao  koro.  Altkoagk  tko  prokakility  distrikatioa  at  a 
fiatitioaa  stags  aay  ko  aoaploa,  tko  dtatrikatioo  of  eaotoaors  at  roal 


service  centers  are  real. 

Before.departing  the  subject  it  should  be  pointed  out  that  the 
probleas  becoae  even  worse  if  ordinary  partial  fraetions  are  used.  Not 
only  oaa  the  tiae  spent  in  a  stage  be  eoaplex,  but  the  routing 
probabilities  aay  be  negatiwe.  Again,  everything  at  the  end  turna  out 
positive  and  real.  For  a  aore  foraal  justif ioation  of  coaplez 
probabilities,  the  reader  is  referred  to  the  artiole  by  Coz  referenced 
earlier.  For  a  justification  of  negative  probabilitiee.  the  reader  is 
referred  to  the  article  by  Bartlett  [BABT45].  Unfortunately  no  aatter 
which  aethod  ie  used,  if  the  ooeffioient  of  variation  CV  (standard 
deviation  divided  by  the  aean)  is  saall.  the  nuaber  of  stages  is 
approziaately  1/C V2  [COI5S], 

Finally,  in  order  to  incorporate  Cox's  aethod  of  stages  into 
queueing  networks  with  aultiple  classes,  additional  subscripts  are 
required.  Figure  6. 7  demonstrates  this.  This  first  subscript  is  the 
service  center,  the  seoond  the  class,  and  the  third  the  stage. 


QUEUE  | 


Figure  1.7  Notation  Kequired  to  Incorporate  Cox's  Method 
of  Exponential  Stagea  into  Queueing  Networks. 
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In  thi^UMini  networks  of  tke  lest  chapter,  the  distribution  of 
custoaers  st  a  service  center  was  invariant  to  the  service  discipline 
as  long  as  it  was  work  conservative.  The  reasons  for  this  were  that  all 
custoaers  were  identical  and  all  service  tine  distributions 
exponential.  If,  however,  there  are  custoaer  classes  associated  with  a 
service  center  then  all  custoaers  are  not  identical,  and  the  order  in 
which  custoaer  are  served  plays  an  iaportant  role.  The  saae  is  true  if 
the  service  distribution  is  not  exponential.  This  is  because  the 
exponential  distribution  is  the  only  one  that  has  the  aeaoryless 
property.  Thus,  if  a  custoaers  service  is  interrupted  the  probability 
of  a  transition  to  another  state  is  not  the  saae  as  before  service  was 
interrupted.  The  role  that  the  service  discipline  plays  should  becone 
clearer  in  the  next  section  when  the  state  space  is  diseussed. 
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.2  Plrat-Coae-Pirtt-Serrlct 

Tka  Merit*  diaeipllae  ia  tkitk  aaatoaar a  in  tmtd  la  tkt  order 
of  tka  it  arriral  at  tkt  aarriaa  ooator  la  eallad  Plrat  Coaa  Plrat  Barra 
(PGPS).  It  la  aoapreeaptiee  aad  aarriaa  daaaad  ladapaadaat. 

d.3.3  Priority 

A  priority  aarrlea  dlaelpllae  la  oaa  la  vkiek  eaatoaara  ara 
olaaaifiad  lato  type a  aad  aaslgaad  a  priority  aoeordlag  to  tkeir  typo. 
Tka  aaxt  aaatoaar  to  ka  aarrad  la  tka  oaa  tkat  kaa  tka  klgkaat 
priority.  If  aora  tkaa  oaa  aaatoaar  kaa  tka  aaaa  priority  tka  oaa  tkat 
arrirad  firat  will  ka  aarrad  firat.  If  aa  arririag  aaatoaar  eaa 
iatarrapt  tka  aarriaa  of  a  aaatoaar  vitk  a  lorar  priority  tkaa  tka 
diaalpliaa  la  aallad  praaaptira  priority.  If  aarriaa  eaaaot  ka 
iatarraptad.  it  ia  oalled  aoapraaaptira  priority. 

6.3. 4 

Alaoat  all  iataraatira  aoapatar  ayateas  aaa  tka  toaad-Kokia  (II) 
aarriaa  diaalpliaa  or  aoaa  deriratire  of  it.  It  ia  alao  rafarrad  to  aa 
tiae-alieiag.  It  ia  dafiaad  ritk  raapaat  to  a  fisad  iatarral  of  tiaa 
oallad  a  qaaataa  (or  tiae-aliee).  Caatoaara  ara  aarrad  ky  a  aiagla 
aarrar  ia  f irat-eoae-f irat-aerra  order  aa  loag  aa  tkair  aarriaa  tiaaa 
do  aot  aaaaad  tka  qaaataa.  Vkaa  a  oaatoaer'a  aarraat  aarriaa  tiaa 
raaakaa  tka  qaaataa.  ka  ia  preeapted  .  A  praaaptad  aaatoaar  raaatart 
tka  qaaaa  at  tka  aad  (aa  if  ka  kad  jaat  arrirad).  aad  taita  to  racaira 
aa  additioaal  qaaataa  of  aarriaa.  leak  aaatoaar  rapaata  tkia  proceit 
aatil  kia  aarriaa  daaaad  ia  aatiafiad.  Tka  adraataga  of  tkia  diacipliaa 
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ia  that  so  asatoaar  hat  to  salt  a  long  period  of  tiaa  bafora  reeeiriag 
•  oaa  aarriaa. -Thaa,  omatosara  with  abort  aarriaa  dasanda  sap  arrire 
aftar  asatoaar  with  losg  aarriaa  daaasda  aad  fialah  ahaad  of  thaa. 

d.1.3 

Tha  aerriee  diaalpliaa  la  vkish  all  esatoaara  raaaira  eqsal  aad 
alaaltaaaosa  aarriaa  froa  a  alagla  aerrar  ia  eallad  Proceaaor  Shariag 
(PS).  That  la.  If  thara  ara  k  eaatoaara  at  tha  aarriaa  caatar  thaa  aach 
asatoaar  alasltaseosaly  race  lee a  aarriaa  bst  at  a  rata  of  (l/k)tk  tha 
aarriaa  rata  .  Vhaa  a  saw  asatoaar  arriraa  at  a  aarriaa  caatar.  ha 
iaaadiately  bagiaa  to  raaaira  aarriaa  at  tha  azpoaaa  of  radsoisg  tha 
aarriaa  rata  to  tha  othar  aiatoaara.  Vhaa  a  asatoaar  coaplataa  kia 
aarriaa.  tha  ahara  of  tha  aarrar  ha  vaa  raaairisg  ie  diridad  eqaally 
aaoag  all  of  tha  raaaislsg  asatoaara.  Tha  PS  aarriaa  diaciplisa  casaot 
ba  catcall?  isplasaatad,  bst  ia  as  ascallast  approxiaat ioa  of  tha  IK 
dlaaiplisa  vhaa  tha  qsaataa  aiaa  ia  aaall  eoaparad  to  tha  aaaa  aarrlca 
tiaa.  Asalytieal  raaslta  ara  asah  aiaplar  thaa  thoaa  for  UL 

d.3.1  Laat-c  ^s-Pirat-Sarra-Praaaatlra-laasaa 

A  aarriaa  diaalpliaa  that  ia  atriatly  praaaptira  la  laat-coae- 
f ir et-aere iaa-praaapt ira-raaaaa  (LCPSPV).  Vhaa  a  aav  asatoaar  arriraa 
at  tha  aarriaa  aaatar,  ha  lstarrspta  tha  asatoaar  that  la  raaairisg 
aarriaa  asd  iaaadiately  starta  to  raaaira  aarriaa.  Vhaa  a  asatoaar 
fisiahaa  baiag  aarrad,  tha  asatoaar  that  vaa  laat  iatarrsptad  rtasaaa 
hie  aarriaa.  Althoagh  thic  aarriaa  diaaipliaa  ia  rarely  saad  is 
praatiaa,  it  ia  iaalsdad  baaasaa  aoat  of  tha  raaslta  that  hold  for  PS 


ISt 


also  hold  for  LCFSPB. 


6.3.7  Inflnlf  Sarrsrs 

If  tha  aaabsr  of  sarrars  at  a  sarrioa  oaatar  is  iafiaita  or  at 
laast  aqaal  to  tha  aaabsr  of  eastoasrs  that  oaa  daaaad  sarrioa 
siaaltaasoasly,  thaa  tha  sarrioa  eaatar  ia  aaid  to  hara  aa  iafiaita 
sarrsr  (IS)  sarrioa  diseipliaa,  Castoaara  always  bsgia  receiving 
sarrioa  iaaadiataly  apoa  arrival,  tharafora  thara  ia  ao  tarries  ordar 
or  waitiag  liaa.  Also,  thara  ia  asrsr  eoataatioa  for  a  sarrsr.  Tha 
sarrsrs  aaaally  do  aot  raprasaat  physieal  rasoareaa.  Sarrioa  oaatars  of 
this  typa  ara  aaad  alaoat  sxelasirsly  to  raprasaat  dalays  that  ooear  ia 
raal  proeassas.  It  is  always  poasibla  to  ooalasoa  IS  sarwioa  eaatars 
iato  a  aiagla  sarrioa  oaatar  by  iaaorporatiag  aaw  olasaaa. 

6.4  Tha  Stata  Saaot 

As  prarioaaly  statad,  ia  ordar  that  a  prooass  ba  a  Nsrkor  procass, 
it  is  aaaassary  that  tha  stata  of  tha  prooass  saaaarisa  all  partiaaat 
past  history.  Por  a  sarrioa  eaatar  with  aaltipla  elassas  tod/or 
aoaaapoaaatial  sarrioa  tiass,  tha  history  that  aast  ba  eoatalaad  ia  tha 
stata  dapoads  oa  tha  sarrioa  diseipliaa.  Por  asaapla.  if  thara  ara 
aaltipla  alassas  at  a  sarrioa  oaatar  aad  tha  sarrioa  diseipliaa  is 
PCPS,  thaa  tha  stata  aast  eoatsia  tha  ordar  aad  class  of  eastoaar  ia 
tha  qaaaa  aad  sarrioa  faallity.  If  tha  sarrioa  tiaa  is  aoaaspoaaat isl 


aad  tha  sarrioa  disaipliaa  is  prossssor  shariag.  thaa  the  stata  aast 
eoatsia  tha  stags  of  sorrieo  that  aaeh  eastoaar  is  ia.  If  thara  ara 
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aaltiple  elimi  and  noaexpoaent ial  service  tiaes  aad  the  service 
discipline  it  preeaptive,  than  the  state  aaat  ooataia  tha  order  in 
which  eaatoaara  are  to  be  served,  the  class  of  each  eastoaer,  aad  the 
stage  of  service  that  a  castoaer  was  ia  before  he  was  preeapted. 

Ia  order  to  keep  the  aotatioa  aaaageable,  the  state  spaoe  will  be 
defiaed  oaly  for  the  class  of  qaeaeing  aetworks  that  have  prod act  fora 
solatioas.  It  aakes  little  scasc  to  do  otherwise,  siaee  at  the  present 
theee  are  the  oaly  aetworks  for  which  exaet  solatioas  caa  be  obtained. 
Except ioas  are  closed  networks  with  a  saall  naaber  of  serviee  centers 
aad  eaatoaara  (See  Chapter  7,  Section  7.4).  The  aotatioa  aad  aaay  of 
the  rcealts  ia  this  chapters  are  froa  the  article  'Opea,  Closed,  and 
Mixed  Networks  of  Qaeaes  with  Different  Claseee  of  Castoaers'  by 
Baskett,  Chandy,  Maatx,  aad  Palaeioaa  [BASK73]. 

Service  oeaters  will  be  referred  to  as  types  FCPS/1/,  PS,  LCFSPB. 
or  IS  according  to  the  following: 

FCFS/1/  -  The  service  center  has  a  single  server  aad  the  service 
discipline  is  f irst-coae-f irst-serve  (FCFS).  Ia  addition  all  castoaers 
aast  have  the  saae  service  tiae  distribatioa  aad  the  distribation  aust 
be  expoaeatial.  The  service  rate  aay  aot  depend  oa  the  aaaber  of 
castoaers  at  the  service  center  (later  ia  this  ohapter  this  restriction 
will  be  reaoved  aad  aaltiple  servers  allowed). 

PS  -  The  serviee  oeater  has  a  single  server  aad  the  service 
dieeipliae  is  proeeeeor  sharing  (i.e.,  when  there  are  k  oastoaers  each 
Is  receiving  serviee  siaalteaeoasly  at  a  rate  of  1/k  seconds  of  service 


per  seeoad).  Eaeh  class  of  castoaers  aay  have  a  distinct  service  tiae 


distribation,  kortnr  «11  d«uity  f auctions  ant  km  rational  Laplace 
transforas.  _ 

LCFSnt  -  Tkt  serTiee  oantar  baa  a  aingla  semer  and  tka  sarnies 
discipline  ia  last-ooae-f  irst-serne-preeapt  ine-resnae  (LCFSPk).  Back 
olaaa  of  eastoaers  recoining  service  at  tkia  eantar  nay  hare  a  diatinot 
sarnies  tin#  diatribmt ion,  however  all  density  fnnetiona  nnat  have 
rational  Laplaoa  tranaforaa. 

IS  -  Tka  nnaber  of  servers  at  tkia  type  of  aerTioe  oantar  is 
infinite  (or  at  laaat  eqaal  to  tka  nnaber  of  oeatoaera  wkick  can  be 
daaanding  aerTioe  aianltanaonaly  at  tkia  oantar).  Book  olaaa  of 
onatoaar  reoeiTing  aerTioe  at  tkia  oantar  aay  kaTa  a  diatinot  aerTioe 
tiaa  diatr ibnt ion,  kowaTar  all  danaity  fnnotiona  nnat  have  rational 
Laplaoa  tranaforaa.  SerTiee  eentera  of  tkia  type  are  said  to  kaTa  an 
infinite  earner  (IS)  aarriea  diaoipline. 

Any  qaeaeiag  network  ooapoeed  of  aerTioe  eentera  of  tkese  types 
kaa  a  prodnet  fora  eolation.  Tka  neat  section  is  eonoerned  with  the 
jnstif ioation  of  this.  Tka  necessary  oonditions  ia  order  for  a  network 
to  kawa  a  prodnot  fora  solntioa  are  :  (1)  the  serTiee  diaoipline  is 
FCFS  and  all  onstoaars  have  tke  saae  serTiee  tiaa  distribution 
ragardlasa  of  olaos,  or  (2)  tke  serTiee  discipline  at  the  serTiee 
center  aaat  be  snob  that  every  oastoaer  starts  to  recoins  soae  serrice 
iaaadiataly  npoa  arriniag  [C1AW77]  (CBANSS).  Sarnioe  center  types  PS. 
LCP8PK,  and  IS  satisfy  tke  second  ooadition.  Altkongk  there  aay  be 
other  serrice  disoipliaes  wkiok  satisfy  tke  second  condition  they  are 
of  little  preetical  sigaifieanoe  sad  will  not  be  d 
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The  state  of  the  network  with  N  service  oenters  and  C  olaasea  is  a 


vector  (z1>x2,...,xN)  where  x^  representa  the  conditions  prevailing  at 
service  center  i.  The  representation  of  x^  depends  on  the  type  of 
service  center  i. 


If  servioe  center  i  is  type  FCFS/1/,  then 
xi  *  (xil*xi2'*“*xiki) 

where 

k^  »  the  number  of  customers  in  servioe 
center  i 

and 

x^.  “  the  class  of  the  customer  jth  in 

FCFS  order.  (6.6) 


If  service  center  i  is  type  PS  or  IS*  then 
xi  "  ^uil*ui2*  *  *  *  *ttiC^ 

where 

“ic  “  **10**20’ •*,,oXi0c^ 

and 

ci  -  the  number  of  class  c  customer  in 
nc 

the  nth  stage  of  service 

and 

X£0  “  total  number  of  stages  for  a  class 

c  customer.  (6.7) 


If  service  center  i  is  type  LCFSP1  then* 


where 


and 


xi  “  **0l,®l***c2,“2*',**'*cki'®ki^ 

kA  -  the  number  of  customers  in  service 
center  i 

(C..O.)  -  the  class  and  stage  of  the  jth 
customer  in  LCFSPK  order. 


(6.8) 
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6.5  Tka  Sta  adv-Stata  Solution 

For  a  .natwork  with  C  claaaaa  and  N  aarvioa  oaatars  of  typa 
FCFS/1/,  PS,  LCFSPE,  and  IS  tha  ataady-atata  probabilitiaa  ara  giwaa 
by: 

*2^*2^  **•  *N^XN^ 


P*xl,x2*  *  *  *'xn)  “  **s**)) 


(6.9) 
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thara  0  ia  noraaliiing  oonatant  ehoaan  to  naka  tha  ataady-atata 
probabilitiaa  ana  to  ona,  X(S(K))  ia  a  function  that  dapanda  on  tha 
arrival  procaaa,  and  aaoh  f ^  ia  a  function  that  dapanda  on  tha  typa  of 
aarvioa  cantar  i. 

If  tha  natwork  ia  oloaad,  than  X(S(K))  “  1.  (6.10) 


If  tha  natwork  ia  opan  and  thara  ia  only  owa  chain,  than 


1-1 


X(S(D)  -  X(a)  , 

whara  E  aqua la  tha  nuabar  of  cuatoaara  in  tha  natwork, 
and  X(a)  ia  tha  aaan  arrival  rata  whan  tha  natwork 
haa  'a*  cuatoaara. 


(6.11) 


If  tha  natwork  ia  opan  and  thara  ara  J  chalna,  than 


X(S(D)  - 


whara  Cj  aquala  tha  nuabar  of  cnatoaara  ia  chain  j, 
and  Xj(a)  ia  tha  naan  arrival  rata  to  chain  j  whan 
it  haa  'a*  ouatoaara. 


(6.12) 
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la  ordir  to  aiapllfy  tki  oqaotioaa  for  lot 

a-1 
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(4.13) 


If  until  ooator  i  la  typo  PCF1/1/,  tkn 


fjtrj)  -  (l/o4) 
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(4.14) 


If  imici  eootor  1  ii  typo  N,  tkn 
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justification  |im.  Several  months  vara  apaat  trying  to  prove  by  local 
balaaca  that-  the  tkaoraa  hold*  for  tha  gaaaral  network.  Unfortunately, 
it  coaid  only  be  ahova  to  hold  for  apacific  aatvorka  (no  general 
typaa  other  than  thoaa  la  tha  laat  chapter).  Thera  are  juat  too  aany 
dograaa  of  fraadoa.  Tha  gaaaraliaad  network  coataiaa  an  arbitrary,  but 
fialto  aaaber  of  aarwica  eaatara  each  of  which  nay  be  typaa  FCFS/1/, 
PS,  LCPSP*.  or  IS.  Ia  addition,  there  ia  as  arbitrary  but  finite  nnaber 
of  claaeee  aaaoolated  with  each  aarwica  caatar,  aad  for  typaa  PS, 
LCPSPK.  aad  IS  tha  aarwica  tiaa  for  each  claaa  aay  ba  raprasanted  by  an 
arbitrary  bat  finite  aaaber  of  azpoaaatial  atagaa.  Tha  aatwork  aay  be 
either  open,  cloaed,  or  aiied,  aad  aay  contain  an  arbitrary  but  finite 
aaabar  of  ckaiaa.  If  tha  network  ia  opoa  or  aizod,  than  each  open  chain 
aay  have  ita  ova  arrival  procaaa  which  aay  dapaad  oa  the  nuaber  of 
ewatoaer*  ia  the  chain. 

The  conclusion  reached  is  that  the  theorea  holds  for  the 
generalised  aatwork,  bat  it  caaaot  ba  proven  to  do  so,  at  least  not  by 
the  techaigae  of  local  balance.  Soaa  other  disappointing  and  disturbing 
facts  sra  :  (1)  tha  egaatioas  for  fj(z^)  types  PS,  LCFSPK,  and  IS  are 
all  incorrect  as  stated  ia  tha  original  paper  (iadicas  and  subscript 
errors),  (2)  tha  egaatioas  do  not  appear  elsewhere  in  open  literature, 
sad  (!)  there  are  ao  azaaplas  ia  open  literature  showing  the  theorem 
holds  for  a  specific  aatwork.  These  statements  are  baaed  on  over  three 
year*  of  research  ia  this  area.  The  reason  for  bringing  out  these 
deficiencies  is  that  all  of  them  will  at  least  be  partially  addressed 


Figure  6.8  depict*  an  arbitrary  network,  and  Fignre  6.9  a  blow-up 
view  of  service  center  3.  Observe  that  there  are  two  castoaer  classes 
at  service  center  3  and  that  the  service  tine  distribation  of  both 
classes  are  represented  by  Cox's  aethod  of  exponential  stages. 

For  the  aoaent  assnae  that  servioe  center  3  is  type  IS.  That  is 
there  are  an  infinite  nnaber  of  servera  at  service  center  3,  and  there 
is  never  a  waiting  line  or  queue.  In  addition  all  castoaers  are 
receiving  service  sianltaneoasly.  and  no  oastoaer  or  class  of 
cnstoaers  affects  the  servioe  of  any  other  castoaer.  Thns,  each  stage 
behaves  as  an  independent  service  center  of  type  IS  with  an  exponential 
distributed  service  tiae.  It  follows  that  the  network  in  Fignre  6.10  is 
equivalent  to  the  network  in  Figure  6.8.  Furtheraore.  the  service 
centers  and  routing  probabilities  can  be  relabled  as  in  Figure  6.11  to 
eliainate  all  class  and  stage  subscripts.  Although  it  was  not 
explicitly  stated  in  the  last  chapter,  a  FCFS  service  center  with  an 
exponential  service  tine  distribution  and  a  service  rate  of 

fti(ki)  -  kj  ni  for  ki>0  , 

is  identical  to  an  IS  service  service  with  the  saae  service  time 
distribution.  Thus,  for  the  network  in  Figure  6.11 
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5,  nd  that  load 


(Not*  tilt  tki  egaatioa  for  (^(1^)  la  froa  ekapter 
dopaadaat  imtii  rataa  will  aot  ka  eorered  aatll  latar  ia  tkla 


akaptar).  folviag  for  tka  relative  throughput!  ia  taraa  of  tka  alaaa 
throughput!  aad  root  lag  prokabilltiaa  yield!: 


f4(kt) 
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Similarly,  fj(xj)  la  Figure  6.9  aad  tka  product  of  the  f4(x4)  over  the 
equivaleat  aat  of  aerrioe  caatars  ia  Figara  6.10  ia 


Nov  corns  14* r  the  csss  ia  which  the  service  iiislyliM 
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csatsr  |  is  processor  sksriag.  Tksrs  is  also  asvat  a  waitlag  lima  or 
qaaaa  at  tkis  type  of  serviee  eaatar.  Nora  precisely,  tks  terser  is 
skara4  eqaally  aooag  all  oastoaers.  Tkas,  tka  oaly  4iffaraaaa  botweea 
ssrriss  saatsr  typos  II  aa4  M  is  tkat  s  -'astoaer  ia  tka  first  rsosires 
oaa  seooad  of  sarrioa  par  saaoad  aad  a  eastoaar  ia  latter  rsosires  l/k1 
seeoads  of  sorrioo  per  seooad,  vkare  ki  is  tka  total  aaakor  of  eastoaar 
ia  tka  PS  sorrioo  eoator.  Tkas,  it  follows  tkat  sorrioo  ooator  3  oaa  bo 
ozpaadod  iato  a  sabaotvork  of  sarrioa  eoatars  jast  aa  was  done  for  tka 
IS  oaao  vitk  tka  ozsoptioa  tkat  tka  eorries  rata  baooaos 


P^kj)  Z(CX) 


for  k^>0  , 


where  i  is  aa  arbitrary  sorrioo  eoator  ia  tko  sabaatwork,  aad  Kj  tks 
total  aaaber  of  custoaers  ia  tka  sabaatwork.  It  follows  froa  Chapter 
3,  Seetioa  5.4.5  that 


fi<ki) 


(1/Zj(a) ) 


fi,  f‘“‘> 


which  aocoants  for  the  fact  that  the  oaly  differeaeo  ia  fjUx)  for  typo 
IS  aad  PS  sorrioo  eoator  is  that  tho  latter  is  prooeded  by  kj^  (the 
syabol  :«  is  aa  assigaaeat  operator). 

Tho  coaolasioa  is  that  aay  aotwork  coaposed  of  FCFS,  PS.  aad  IS 
sorrioo  ceators  caa  be  aappod  iato  aa  oqairaleat  aotwork  by  lettiag  the 
stages  grow  to  fall  service  ceators.  Heace,  the  proofs  ia  the  previoas 
chapter  are  snfficieat  to  cover  a  large  class  of  aetworks,  bat  aot  all 
of  those  coasidored  by  Baskett. 


L«nl  kalaaoo  vao  described  la  tk«  last  ikiptir  aa4  it  •tally 
iitn4»Ot  ulxika  «ltk  alaaaaa  aa4  m«if«Mitlal  aarviaa  tlaaa.  It 
MUtx  tki  rat*  of  flov  iato  a  atata  4aa  to  a  olaaa  •  customer 
oator lag  a  atago  of  sarvioo,  to  tka  flow  oat  of  tkat  atato  4aa  to  a 
olaaa  a  aaatoaar  leaving  tkat  atago  of  service.  Proa  tko  description  of 
looal  kalaaoo.  It  la  easily  aooa  tkat  aaak  glokal  kaiaaaa  equation 
(ogaatoa  total  rata  of  flo*  iato  a  atato  to  total  rata  of  flov  oat  of  a 
atata)  la  a  saa  of  looal  kalaaoa  equations.  Tkaroforo,  tka  aolatloa  to 
tko  looal  kalaaoo  oqaatioaa  aatiafioa  tko  glokal  kalaaoa  aqaatloaa. 

Some  iaaigkt  oaa  ka  gaiao4  ky  rooalliag  tko  origiaa  of  glokal  a ad 
looal  kalaaoo  oqaatioaa.  Glokal  kalaaoo  oqaatioaa  aro  derived  froa  tka 
foot  tkat  a  qaaaaiag  aatvork  la  a  ami ti4iaaaaioaal,  klrtk  a  ad  death, 
Markom  prooaaa.  It  ia  tko  aolmtioa  of  tko  glokal  kalaaoa  aqaatloaa  tkat 
ia  iaportaat.  Hovavar  if  tko  aatvork  ia  opaa,  tkara  ia  ao  way  to  solva 
tkaaa  aqaatloaa  aatkaaatioally  (tkara  ara  always  sort  aakaovas  than 
•  quatioaa).  Tka  oaly  vay  to  obtaia  a  aolatloa  is  to  gaaaa.  Oaa  vay  of 
gaassiag  is  to  aaaaaia  looal  kalaaoa.  That  ia,  looal  kalaaoa  is  an 
assumption  vhioh  may  or  say  not  ba  trua.  If  tha  assumption  is  falsa 
than  tko  looal  kalaaoa  aquations  vill  ba  iaoonsistaat. 

Tha  taohaiqua  and  povar  of  looal  kalaaoa  vill  ba  demonstrated  by 
an  example.  Consider  tha  problem  of  finding  tha  staady-stata 
probabilitias  for  tha  aatvork  in  Figure  4.12.  Tha  service  discipline  is 
prooassor  sharing  and  thara  ara  tvo  customer  classes.  Class  1  and  class 
2  customers  arrive  from  Poisson  sources  vith  naan  rates  of  snd  X2 


CLASS  1 


Figaro  4.12  Tyr*  Ft  Service  Center  with  Two  Clinti. 

respectively  (tk«  two  soareos  eoald  bo  eoabiaed,  bat  tbia  will  aot  ba 
doao  boro).  Tbo  aorwloo  tlaoa  of  elaaa  1  a  ad  olaaa  2  oaatoaara  art 
exponentials  diatribatod  with  aaaaa  1/pj  a  ad  l/pj  respeetivel y.  Sine# 
tbo  aorwioo  diaoipliao  ia  proooaaor  sharing,  tbo  aorwica'.rataa  dapand 
on  tha  noabar  of  oaatoaara  in  tba  aarvioa  oantar.  Tha  aarvioa  rata  of  a 
olaaa  1  caatoaar  ia  vbara  oqaals  tba  nnabar  of  elaaa  1 
oaatoaara  in  tha  service  oantar  and  k2  tha  naabar  of  elaaa  2  oaatoaara. 
Siailarly,  tha  aarvioa  rata  of  a  olaaa  2  caatoaar  ia  p2/ (kj+k2).  The 
probability  that  a  elaaa  1  caatoaar  departa  tha  aarvica  canter  in 
inf initaaiaal  tiaa  h  ia  [h  k^  Pj  /  (kj+kj)].  Similarly,  for  a  class  2 
costoaor  tha  probability  is  [h  k2  P2  /  (k2+k2)].  Let  the  steady-state 
probabilities  ba  represented  by  P(k2,k2),  where  kj  and  k2  are  the 
naabar  of  elaaa  1  and  elaaa  2  customers.  The  atate-trans it  ion-rate 
diagraa  of  tha  network  ia  depicted  in  Figare  6.13. 
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Tk«  (Ulil  MUtiota  for  ititti  vitk  tte  or  fowor 

lUtOMII  IM1 

(x1»va)Ko.o)  -  »2Pd.o)  ♦  ^p(o.i) 

(X1^X2«n1)P(1.0)  -  OjPd.O)  ♦  1*jP<1,1>  ♦  XjP(O) 

(X^Xj^lKO.l)  -  ^jPU.l)  ♦  (^KO.a)  ♦  XjP(O) 

(X1^X2^h1)P(2.0)  -  HjPd.O)  ♦  AjijPd.i)  ♦  XjKl.O) 

(Xi+x2>  ♦  Anj)P(i.i)  -  jujPd.i)  ♦  JujPd.a)  ♦  x^o.i)  ♦  Xjpd.o) 

(Xj+Xj+h^PCO.*)  -  AnjPd.2)  ♦  HjPtO.I)  ♦  X2P<0.1>  . 

Notloo  that  thoro  in  sis  aqaatioaa  tad  toa  aakaoaat.  No  aatt*r 
how  aanj  aqaatioaa  aro  writtaa  oat  thoro  will  ilfija  bo  aoro  aquation* 
than  uafcnowaa!  Tho  oorroapoadiag  local  balanca  aqaatioaa  aro: 

XjPCO.O)  -  pjPd.O) 

XjPCO.O)  -  j^PCO,!) 

XjPd.O)  -  (ijPd.O) 
x2P(i,o)  -  l^Pd.i) 

iijPd.o)  -  x^o) 

XjPCo.i)  -  iniPd.i) 

X2P(0,1)  -  h2P(0,2) 
l^Pd.l)  -  X2P(0) 
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X1P(2.0)  ■ 

-  gjPd.O) 

X2P(2.0)  « 

-  jujPd.l) 

PtP(2.0) 

-  X1P(1.0) 

XjPCl.l) 

.  i^Pd.l) 

X2P(1.1) 

-  J^Pd.2) 

^Pd.l) 

-  XjP(O.l) 

J*2p<ld> 

-  XjPd.O) 

X^P(0,2)  - 

^jPd.2) 

X2P(0.2)  - 

|i2P(0*3) 

|»jP(0,2)  « 

hjtiO.l)  . 

Solving  these  equations  in  tens  of  P(0,0)  yields: 

P<1,0)  -  Ui/dj)  P<0.0> 

P(0,1)  -  (X2/»a2>  P(0,0) 

P(2.0)  -  (Xj/^)2  P(0,0) 

P(l.l)  -  2  (Xj/iij)  (X2/n2)  P(0*0) 
P(0,2 )  -  (X2/»i2)2  P(0,0) 

P(3,0)  -  (Xj/jij)3  P(0,0) 

P(2,l)  -  3  (Xj/lij)2  (X2/|i2)  P(0,0) 
P(l,2)  -  3  (X1/|i1)  (X2/|»2)2  P(0,0) 
P(0,3)  -  (X2/|i2)3  P(0,0)  . 
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Although  it  ai7  bi  a  little  difficult  to  •••  without  aolviag  aor* 
•qutioai  the  fora  of  tko  aolutiou  ia  : 


Pfkj.kj)  -  uj1  kj2]  [(kj+k^)  |  (l/gjl^d/kj!)  (l/gjl^d/kjl )  1  P(0.0). 

Notiea  that  tko  firat  term  ia  braokete  correaponda  to  tka  eqaatioa  for 
X(S(K))  with  two  ohaina.  The  aeooad  term  ia  braokete  oorreepoada  to  the 
eqaatioa  for  f4(xt)  (type  PS),  where  e^  -  e i2  -  1.  Obwioaely  0  equal 
1/P(0,0). 

The  power  of  looal  balaaee  ia  :  aaswera  oaa  be  obtained,  aad  it  ia 
oaly  neoeaaary  to  gaeaa  at  tke  geaeral  fora  of  tke  aolatioa.  Ia  order 
to  akow  tke  equation  a  for  f^x^)  are  valid  for  otker  typea  of  aerwioe 
centera,  tkia  aaae  problem  ia  worked  ia  Appendix  A  for  FCFS  and  LCFSPK 
aerwioe  diaoiplinea.  Ia  addition.  Appendix  A  alao  oontaina  an  example 
of  a  aerwioe  center  with  two  exponential  atagea  and  LCFSPK  aerwice 
diacipline.  Aa  prewionaly  atated  tkeae  are  tke  only  known  examplea 
demonatrating  that  the  ateady-atate  eqnationa  in  thia  auction  are 
valid. 

Unfortunately,  only  a  email  aubeet  of  aerwioe  centera  have  local 
balance.  For  example,  if  the  aerwice  diaoipline  of  the  network  in 
Figure  6.12  ia  changed  to  nonpreemptiwe  priority,  looal  balance  ia  not 
applicable.  Thia  can  eaaily  be  aeen  by  writing  the  global  balance 
eqnationa.  Let  (x^^,...,!^)  repreaent  the  atate  of  the  network,  where 
x^  ia  the  olaaa  of  the  cuatomer  currently  being  aerwed,  x2  the  claaa  of 
the  cuatomer  to  be  aerwed  next,  Xg  the  claaa  of  the  cuatomer  after  x2, 
etc.  The  global  balance  eqnationa  for  all  atatea  with  two  or  fewer 
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(Xj+XjJFCO)  -^Pd)  ♦  P2P<2> 

<X1+X2"'P1)P(1>  *  *lP<1‘1)  +  I^K2.1)  ♦  XjP(O) 

(xi+xi+^i>p(2>  "  Pip(1*2>  *  PjKi.i)  ♦  4P(0) 

(X1+X2^1)P<1'1>  “  Pip<l»1*1>  ♦  Pjp(2.1.1)  ♦  XjPd) 

(X1+X2+I*1)p(l*2)  “  PjKl.1.2)  ♦  Pjp(J#l»2)  ♦  X2P(1) 

(X1-*-X2+^2)P(2.1)  -  XXP(2) 

(X1+X2+|12)P(2*2)  “  »»1P<1*2*2>  ♦  P2P(2,2»2)  ♦  X2P(2)  . 

To  show  that  loesl  balance  is  sot  sppliosbls  sll  one  needs  to  do  is 
exaaiae  ths  sixth  equation.  Thsrs  srs  thrss  ways  to  depart  stats  (2.1) 
and  only  oas  way  to  satsr  it.  Thas.  looal  balaaes  oaaaot  apply,  aor  oaa 


it  bo  sxtsadsd  to  do  so. 


iTIK-LlLHIVMT  1)1  ■  W  W I  llllH !  I WKWT11 


ways  to  dsoart  a  stats  than  satsr  it.  This  is  aot  surprising  sines  it 
doss  not  asst  ths  nsessssry  conditions  for  a  product  fora  solution. 

It  is  also  prowsn  in  Appendix  A  that  local  balance  is  not 
applicable  if  ths  serrice  discipline  is  FCFS  snd  enstoasrs  do  not  hsye 
ths  saas  service  rats.  |i.  In  this  case  local  balanes  equations  can  be 
written,  bat  they  are  inconsistent. 
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ibt  pr«kiktllil«i.  Ii  till  eoetioa  ■it| lul  4Utrtktiloti 

ere  o*  t  a  i aod  Ip  i||rt|«iia|  ilaui.  Lai  tha  apitaa  atata  ba 

t ha  atabat  of  aiataaara  of  aaah  claaa  ta  aaah  aattlat  center.  Bora 
farail Ip  tha  aggregate  apataa  atata  Ii  taflaaf  to  ha  tha  factor 

( T  j  .  y  2 , ,  where  y(  ■  (hjj.k^j . klC*  hjc  *•  tha  atakar  of 

aiataaara  of  claaa  c  la  eerwiee  aaatar  i.  Also,  lat  l/p({  ha  tha  aaaa 
aeralee  tiaa  of  alaaa  a  aaatoaar  at  aaralaa  aaatar  l.  Tha  ateady-etate 
aggregate  yrohahil 1 t iaa  ara  given  hy 


Pfyj.yj . yN)  -  X(*(D) 


•l(*l>  •J<^2)  ••• 


aha  ra 


C  k| 

ki'  JJ  **'**'"  <*l./«‘i.>  U 


*1 <^1 >  *  { 


for  i  FCFS/1/, 
PS.  or  LCFSP*. 


C  k 

<>/»„!> 


la 


for  i  IS. 


(6. IS) 


Tha  azpraaalona  for  gj(y^)  »ra  derived  hy  naaiag  fj(Zj)  orar  all  ij 
with  Th*  ■altlaoaial  thaoraa  and  Equation  6.2 

ara  uaaful  (an  ezawple  will  ba  given  latar).  Nota  that  for  typa  FCFS/1/ 
aaralaa  cantari  tha  haa  baaa  aoaad  iaaida  of  tha  iiaaitloi  and 
chaagad  to  p^c.  Thia  waa  doaa  both  to  aiaplify  tha  aotatioa  and  to 
oaphaaize  tha  aiailaritiaa  batwaan  FCFS/1/,  PS,  and  LCFSPK.  It  ia 
howaaar  required  that  for  FCFS/1/ 

>41  "  >*i2 . **ic  • 
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(6.19) 


The  fact  that  tha  nnabtr  of  customers  is  a  oloaad  chain  is 
constant  itiptti  cliainating  class  distinction  and  diatingnishing 
cnatoacrs  according  to  chains.  More  precisely  let  the  network  state  be 

(S1‘X2'***'*N>  wk#r*  *i^ki1»ki2'"*»kij)  alld  kij  ix  tke  nn"bet  of  ®kain 
j  onstoaers  at  service  center  i.  It  follows  froa  the  anltinoaial 

theorea  that 


■  V  \ 

V  V 

1  .  K  .  Jh 
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i 

V’.«V 

.>N. 

.yv» .  * 

Vv  V 
V  v  v 

&& 


P(z^.i2» • • • »zn)  *  X(S(K)) 


w^(*i)  *2(12)  ... 


Nv  N' 


\\n_V 


where 


wi(*i) 


fk,!  f]  d/kyl)  Cy/kij)1*1  . 
)  J‘l 


for  i  FCFS/1, 
PS,  or  LCFSPR, 


for  i  IS, 


1  1 


kij  “  J  ki0 

c  in  j 


•  nnaber  of  chain  j  enstoaers  at  service  center  i. 


•ij  •  J  «ic 
c  in  j 


the  relative  throughput  of  a  chain  j  custoaer 
through  service  center  i. 


1/Pij- 


(1/eij)  J  (•ic/Mic) 
c  iu  j 


ness  service  t lae  of  s  caste 
custoaer  at  service  center  1 


Observe  that  the  equation  for  t j(ij)  is  tsoacrpbtc  t<  k*  • 
for  gj,(y^).  That  is,  class  psrsaeters  er*  sinpir  r»r  •  * >•  - 


paraaeters.  Also  note  that  if  tfcere  It  i>tl» 
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*i(*1)  “  gjtjTj).  Tli*  idvintip  of  this  aggregate  atata  ower  the 
prarioaa  oaa  la  that  tha  auaber  of  faaaihla  network  atataa  haa  bean 
aigaif icaatly  radnoad.  It  follova  that  aiaoa  tha  parpoaa  of  6  ia  to 
forea  tha  aaa  of  tha  probabilitiaa  owes  all  faaaibla  aatworka  atataa  to 
oaa  that  it  ia  aneh  aaaiar  to  dataraiaa  6  naiag  thia  aggregate  atata. 
If  oaa  requirea  probability  diatribatioaa  by  olaaa  tha  walaa  of  6  oaa 
thaa  be  aabatitatad  iato  tha  prewioae  aat  of  eqaatioaa. 

A  farther  aiaplieatioa  ia  poaaibla  by  dafiaiag  tha  aggregate  atata 


.’|i  4*f  *|  ,*#  *‘'f  ,*(  *»  , 


/<  -Vi  »i 


networks,  algorithas  to  ealenlst#  the  noraslizing  constant  do  not  use 
it  (closed  networks).  They  rely  on  the  fact  that  noaber  of  onstoaers  in 
each  chain  is  constant.  On  the  other  hand,  if  the  network  is  open  and 
the  aean  arrival  rate  is  oonstant,  then  a  closed  fora  expression  for 
the  noraalixing  oonstant  can  be  obtained  with  the  aid  of  these 
equations.  This  will  be  dose  is  the  next  section.  Is  contrast  to  the 
earlier  equations  this  set  of  aargisal  steady-state  equations  appear 


il  places  in  the  literature  [KLEI76]  [BKUE80]  [SAUE81] 


[LAVE83] . 

As  proaised  earlier  the  aaterial  in  the  section  will  be 
illustrated  by  an  exaaple.  Assuae  that  the  service  center  in  Figure 
6.14  is  type  PS. 
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For  this  tarries  center, 
'  r.  .  V*211 
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Sun i&g  over  ill  ^211f  ®212#  ^213*  ®221#  mi  ®222  thit 

*211+®212+*213*k21  *ad  a221+tt222mk22  r**®lt*  ia: 
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Sine*  the  »'»  are  relative  throughput*  the  tern  inside  the  brackets  is 
the  average  servioe  tiae  and  e 21**22  th#  throughput  of  a  chain 
j  custoaer.  That  is. 


vv-gM  . 


where 


kj  "  k2'  ®2j  “  *21+*22'  *“d 


*21  1  "22  1 
®21+*22  **21  ®21+*22  **22 


Nov  sinoe  there  were  only  two  classes  at  service  center  2  and  both 


of  these  belonged  to  chain  j,  it  should  be  obvious  that  1*2^2) 
w2^k2^*  *a  **ct  ike  expression  for  1*2^2)  was  derived  earlier  as  1 


interaediate  step  and  is: 


....  f  *21  *22  1  2 

**  ^  ’  l  **21  +  **22  J 


Jj  1 1  j 


m  uij 


For  an  open  network  with  a  constant  aean  arrival  rate,  it  is 


possible  to  obtain  closed  fora  solutions  for  the  noraalizing  constant 


and  steady-state  probabilities.  If  aean  arrival  rate  is  constant,  then 


the  aarginal  steady-state  probability 


(6.22) 


kj/kj)  h2(k2>  *•*  W 

p<ki'*2 . V  “  x  - 5 - • 


vh«re  K  -  kj  ♦  kj  ♦  ♦  kN  .  Multiplying  the  nuaeretor  end 

denoainetor  by  X  end  letting  6  ebeorb  the  X  in  the  denoainetor  reenlte 
in: 


P(k^f kj, . . .  ,kjj)  ■ 


{xkl  hjtkj)}  uk2  ^(kj))  •••  uk*  1^(1^)} 


(6.23) 


The  noraelizing  conetent  ie  deterained  by  snaaing  this  expression  over 
sll  fessible  ststes.  Thet  is, 

OB  CO  •  L  V  ^ 

G  -  5  J  ...  J  [U  1  kl(ki))  (X*2  h2(k2) )  ...  (X  N  hN(kN))] 

kj-0  kj-0  kjj*0 


U:**  Lit**  **“*’1  - wl.‘ 


(6.24) 


Henoe,  the  expression  for  G  fsotors  into  teras  where  each  tera  involves 
only  psrsaeters  for  s  single  service  center.  Thst  is, 

N 


where 


r  ki 

Gi  -  2  k  Mki>  • 


(6.25) 


k4»0 


It  follows  froa  the  definitions  of  Gj  end  P4(0)  thst: 


The  results  are  saazing!  For  FCFS/1/,  PS.  sad  LCFSPR  service 
centers  the  asrginal  distribntioa  is  the  ssae  ss  the  distribation  of 


customers  in  an  M/M/1  systea.  If  the  service  center  has  an  infinite 
nnaber  of  servers,  then  the  marginal  diatribntion  it  the  eaae  as  the 
distribution  of  an  M/M/«  (with  an  appropriately  defined  p^).  Moreover, 
the  network  steady-state  probabilities  factor  into  products  with  one 
tera  for  each  service  center,  and  each  tera  is  the  solution  for  that 
service  center  'in  isolation'  with  a  Poisson  input  and  with  an 
exponential  serviee  tiae  and  appropriately  defined  pj. 

It  follows  that  since  the  distribution  of  oustoaers  are  the  saae 
that  the  Bean  values  are  the  saae.  That  is, 

if  i  FCFS/1/,  PS,  or  LCFSPK 

if  i  IS.  (6.29) 

Since  the  network  is  open,  the  aean  rate  that  oustoaers  enter  the 
network  equals  the  aean  rate  that  custoaers  leave  the  network.  Thus, 
the  throughput  equals  the  aean  rate  that  oustoaers  enter  the  network. 
The  saae  is  true  at  the  servioe  center  level.  Sinoe  eic  equals  the  aean 
nuaber  of  visits  a  custoaer  aakes  to  service  center  i,  class  c,  it 
follows  that  the  throughput  of  service  center  i  is 

Ti  -  X  J  eic  .  (*‘30) 

c 

Given  the  aean  nuaber  of  custoaers  and  the  throughput,  the  aean 
response  tiae  can  be  calculated  froa  Little's  law.  Usually  it  is  the 
perforaance  aeasure  of  the  service  centers,  not  the  overall  network, 
that  is  of  interest. 

If  there  is  aore  than  one  service  center,  the  distribution  of  the 


response  time  cannot  be  determined.  Title  is  beoense  the  response  times 
st  the  service  oenters  ere  not  independent  [BURX64].  Notion  that  if  s 
network  oonsists  of  s  single  service  oenter  with  nil  onstomer  classes 
hawing  the  same  exponential  service  time,  then  the  distribution  of 
customers,  throughput,  and  mean  response  time  are  the  same  for  service 
oenter  types  FCFS/1/,  PS,  and  LCFSPR.  As  pointed  out  by  Kleinrock, 
although  the  mean  response  times  are  the  same,  there  is  a  large 
difference  in  the  variances.  One  may,  therefore,  oonclude  that  the 


te  time  by  itself  is  not  a  very  good  indicator  of  system 


performance  [KLEI76]. 


6.5.6 


1 1 1  m  j  [»Quin  nTTWTT  ■ .  n  nnruii/ui 


The  serviee  rate  at  a  service  oenter  is  said  to  be  load  dependent 


if  the  rate  that  enstomers  are  served  depends  npon  the  number  of 
customers  at  the  service  oenter.  For  example,  if  a  service  center 
contains  identical  and  multiple  servers  then  the  service  rate  is  a 
function  of  both  the  number  of  customers  and  the  number  of  servers.  In 
the  previous  chapters  this  has  been  expressed  as: 


where 


!»£<*£)  • 


*i  jij  for  kji  mj 

■i  Pi  to r  k£2  ni 


k^  “  the  number  of  customers  st  service  center  i 
-  the  number  of  identicsl  servers 
li^  ■  the  service  rate  when  k^  -  1  . 


(6.31) 
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The  class  of  networks  discussed  in  this  chapter  can  be  extended 


not  only  to  include  this  case,  but  sore  general  cases  as  well.  If 
Z^k^)  is  the  relative  service  rate  (relative  to  which  is  the 
service  rate  when  kj*l)  at  service  center  i  when  there  are  k^  custoaers 
at  service  center  i  then 


£i<*i> 


«i(*i> 


wi(ai) 

hi(ki) 


(6.32) 

(6.33) 

(6.34) 

(6.35) 


where  :■  is  an  assignaent  operator  and  is  read  as  'becoaes'.  The  proof 
of  these  equations  is  identical  to  the  one  in  the  previous  chapter 
section  5.4.5  where  the  subset  of  service  centers  is  siaply  service 
center  i.  The  only  restrictions  on  Z^(k^)  are  that  it  be  a  positive 
function  of  kj  and  Z£(l)"l.  However,  it  is  usually  assuaed  that  there 
exist  soae  a  suoh  that  for  all  k^2*  Z^k^Z^a).  For  exaaple,  for  the 
identical  and  aultiple  service  center  case 


Zi(kt) 


for  k^  ■1 
for  kj2  Bj 


(6.36) 


and  the  service  rate  is  Zi(k^).  Such  service  centers  are  often 
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nftrrid  to  it  'Halted  load  dependent'  center*  because  the  service 
rate  depends  npon  kj  only  up  to  a.  It  will  be  assnaed  throughout  this 
chapter  and  the  next  that  all  load  dependent  service  centers  are  of 


this  type. 


Nov  let 


«i“  J  K*ic/l4c> 


(6.37) 


and  pj  -  g^/Zj^a).  Also  let  6^  equal  the  coaponent  of  the  noraalizing 
constant  that  is  dne  to  service  center  i.  That  is  6^  “  l/P^CO).  It 


follows  that 


**  k  "  k  ^  i 

-  5  xt  1  ^(ki)  - )  1  n  i/Zi<*> 

k^»0  k^-0 

a-1  k  ^i  •  k  ki 

-  )  1  n  i/Zi€») +  5  1  n  i/Zi<»> 

kj-0  •-!  ^-a  •**1 

»-l  k  ^i  ■  •  k 

*  5  «i 1  n  i/zi<»> +  ?i*  n  i/Zi(»>  5  Ui/Zi(»>] 1  • 

kj-0  *-1  »*1  k^O 
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-  +  \  -  • 
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a)  (1-Pi)  1  II  Zi(a) 


(6.38) 


Siailarly,  the  aean  cnstoaer  population  at  service  center  i  is 

1  —  j  —  kj 
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.  (6.39) 


For  the  the  speciel  ease  of 


Zi<ki> 


{“ 


for  kjl  ml 
for  k^  ■£  , 


(6.40) 


Gj  and  reduce  t d 


T  (-iPi) 

2  ~T7T-  + 

ki-1  1 


■!  (1-pj) 


(6.41) 


Pi  ("iPi)*1 

Lj  -  «iPi  +  - r 

Gt  nl  (1-pj)2 


(6.42) 


It  should  not  be  surprising  that  Gi  is  identical  to  1/Pq  for  the  M/M/n 
system  and  Lj  equals  L  of  the  M/M/m  system.  Also  note  that  p^  is  in 


snt  vith  the  ntilization  of  the  M/M/m  system. 


There  are.  however,  cases  when  one  might  want  to  assign  Z^(k^) 
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differently.  In  those  eases  the  aore  eoapliested  expressions  nust  be 


nsed.  In  closing,  the  results  of  this  section  are  valid  for  FCFS.  PS. 
and  LCFSP1  service  disciplines.  However,  unless  it  is  explicitly  stated 
that  the  service  rate  is  load  dependent,  it  will  be  sssuaed  to  be  load 
independent.  Furthermore,  the  notation  FCFS  vill  be  sssuaed  to  iaply 
FCFS/1/  (load  independent)  unless  stated  otherwise. 

6.5.7  An  Example  of  Queue ins  Networks  with  Multiple  Classes 

The  following  is  the  only  known  exaaple  of  an  open  queueing 
network  with  aore  than  one  class  of  customers  and  aore  than  one  service 
center.  The  exaaple  is  froa  'Computer  Perforaance  Modeling  Handbook* 
[LAVE831.  The  exaaple  was  not  intended  to  illustrate  the  analysis  of 
queueing  networks,  but  to  show  that  the  nuaber  of  classes  required  to 
describe  the  routing  can  be  significantly  reduced  by  coabining  sources. 
Unfortunately,  the  exaaple  as  it  appears  in  the  reference  does  not 
contain  a  figure  showing  the  routing,  and  therefore  is  very  difficult 
to  follow.  In  addition,  all  equations  and  results  are  stated  in 
sentence  fora.  The  exaaple  as  it  appears  here  has  been  greatly 
expanded. 

Figure  6.15  depiots  the  aodel  of  a  saall  communications  network 
organized  as  a  ring.  Messages  (customers)  originate  at  the  sources  and 
terainate  at  the  sinks.  Every  aessage  aust  pass  through  one  or  aore 
coaaunication  links  (service  centers).  For  exaaple,  a  aessage  froa 
source  1  goes  through  link  1  to  get  to  destination  2,  through  links  1 
and  2  to  get  to  destination  3,  and  through  links  1,2,  and  3  to  get  to 


destination  4.  A  message  f ron  source  2  goes  through  link  2  to  get  to 
destination_3.  through  links  2  end  3  to  get  destination  4,  and  through 
links  2,3*  and  4  to  get  to  destination  1.  Messages  from  sources  3  and  4 
behave  similarly. 

SOURCE  SINK 


SINK  SOURCE 


Figure  6.13  Model  of  a  Communications  Systea. 

The  routing  of  messages  in  the  network  oannot  be  described  by  a 
single  set  of  routing  probabilities.  This  is  because  the  routing 
probsbilities  depend  on  where  the  nesssge  originsted.  For  example  a 
message  from  source  1  that  passes  through  link  3  must  terminate  at 
destination  4.  whereas  messages  from  the  other  sources  may  be  routed 
through  link  4.  In  order  to  describe  the  rooting,  it  is  necessary  to 
partition  the  messages  into  classes.  If  it  is  assumed  that  there  are 
four  sources,  then  six  classes  per  service  center  are  required  to 


describe  tbe  rooting  (see  Figure  6.16).  For  example,  source-destination 
pairs  of  sassages  that  pass  through  link  two  are 
(2.3). (2. 4). (2.1). (1.3). (1,4).  and  (4.3). 
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Figure  6.18  Classes  Required  for  Routing  with  Multiple  Sources. 


On  the  other  hand  the  number  of  classes  at  each  service  center  can 
be  reduced  by  combining  the  four  sources  into  a  single  (aggregate) 
source.  This  reduces  the  number  of  classes  at  each  service  center 
required  to  describe  the  routing  to  three,  one  for  each  possible 
destination  (see  Figure  6.17).  For  example  at  service  center  2  classes 
are  required  for  destinations  3,4  and  1.  Thus,  a  minimum  of  12  classes 


each  service  ceatar.  The  service  rata  Cp.^)  ia  2400/360  or  6.67 
aessages  p at-  aaooad  (the  aessag*  length  include*  overhead).  The 
relative  throughput  aquation*  are  : 

■  1/12  +  *42 
*12  “  1/12  +  *43 
e12  "  2^12 

*21  "  1/12  +  *12 
*22  “  1/12  +  *13 
*22  “  1/12 

*31  "  l/l2  +  *22 
*32  “  l/l2  +  *23 
*32  "  1/12 

*41  "  1/12  +  *32 

*42  “  1/12  +  *33 
e42  -  1/12  . 

Solving  thaaa  equation*  result*  in  : 

*11  “  *21  “  *31  “  *41  “  1/4 

*12  "  *22  “  *32  “  *42  “  1/6 

*13  “  *23  “  *33  “  *43  “  1/12  * 

The  utilization  at  each  service  canter  is  : 

Pi  -  ^  K'ic/Pi)  “  (h/l»i)  (•il+*i2+*i3* 


<10/*. $7) (1/4+1/6+1/12)  -  0.7S 


The  m«b  ttipoait  tine  at  aaoh  aarrioa  center  ia 


R.  -  — —  •  3/5  “  0.6  aeconde  par  aeaaagea. 
i  Tt 

Thus,  tha  aaan  raapoaaa  tlaaa  of  aaaaagaa  that  paaa  through  1.2  and  3 


service  cantara  ara  0.6a.  1.2a  and  1.8a  respectfully.  Tha  aaan  raaponaa 
tiae  of  an  average  aaaaaga  ia  tha  waightad  ana  of  tha  aeana.  Since  all 
aaana  ara  equally  likely,  tha  aaan  raapoaaa  tiaa  of  an  average  aeaaage 
ia:  (0.6)(l/3)+(1.2)(l/3)+(1.8)(l/3)  -  1.2  aeeonda. 

One  of  tha  problaaa  feeing  the  daaigner  of  a  coaannicat ion  network 
ia  buffer  aixa.  If  it  ia  too  aaall  than  aaaaagaa  will  be  loat.  In  order 
to  properly  dataraina  tha  buffer  aixa.  one  neada  to  know  the 
diatribntion  of  aaaaagaa  at  each  service  canter.  That  ia,  aore 
inforaation  ia  required  than  jnat  the  aean.  For  exaaple,  the 
probability  that  tha  aervice  cantara  in  Figure  6.8  containa  aore  than  6 


Ptkj  >  6)  -  1  -  [P(0)+P(l)+(2)+(3)+(4)+P(5)+P(6)l  -  0.1334  . 

That  is,  13:34  percent  of  tit  tiae  a  service  center  contains  aore  that 
6  cost oaers.  Hence,  even  though  the  seen  is  only  3  aessages  a  buffer 
site  of  6  is  inadequate! 
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Tki  equation*  derived  in  the  last  chapter  five  only  the  fora  of 
the  eolntion  for  closed  and  aized  network*.  Nor*  specifically,  a  closed 
fora  expression  for  the  noraalizing  constant.  G,  was  not.  and  in 
general  cannot  be  obtained.  The  reason  for  this  is  that  the  nnaber  of 
enstoaers  in  a  closed  chain  reaains  constant,  and  therefore  the 
distribution  of  enstoaers  at  the  individual  aervic*  oenters  are  not 
independent.  By  definition,  the  noraalixing  constant,  0,  is  the 
suaaation  of  all  unnoraalixed  probability  distributions  over  all 
feasible  networks  states.  Clearly,  for  a  closed  network  the  nuaber  of 
feasible  networks  states  equals  the  nuaber  of  possible  ways  that 
enstoaers  can  be  distributed  over  the  network,  such  that  the  nuaber  of 
enstoaers  in  each  chain  reaains  constant.  Unfortunately  this  nuaber 
increases  rapidly  as  the  nuaber  of  service  centers  and/or  the  nuaber  of 
enstoaers  increases.  The  reader  is  referred  to  the  ezaaple  in  Chapter  5 
in  which  a  network  consisting  of  a  single  chain  with  eight  service 
centers  and  20  oustoaers  yielded  888,030  network  states.  It  should  si  so 
be  noted  that  each  tera  in  the  suaaation  contains  virtually  every 
paraaeter  associated  with  every  service  center  in  the  network.  Thus, 
even  for  the  saallest  of  networks  the  expression  for  G  would  probably 
be  too  coaplex  to  deteraine  how  the  paraaeters  affect  perforaance. 
Fortunately,  there  are  other  ways  of  deteraining  G  than  directly  froa 


its  definition.  loviTir,  any  expression  derired  fro*  these  it  still  so 
eoaplsz  that  nasally  all  oaa  oaa  haadls  is  tha  anaerioal  result. 

At  tha  prasaat  thara  ara  thraa  algorithas  for  deteraiaiag  tha 
parforaaaoa  aatries  of  elosad  aatworhs  :  tha  Coarolntioa  algoritha,  tha 
Maaa  Valaa  Analysis  (KVA)  algoritha,  aad  tha  Looal  Balaaca  Algoritha 
for  Noraalisiag  Coastaats  (LBANC).  All  aztaad  to  tha  fall  olass  of 
aatvorks  knova  to  hare  a  product  fora  solution.  Howere r,  ao  oaa  of  thaa 
is  bast  for  solring  all  problaas  oa  all  aaohiass. 

Bafora  disoussiag  tha  adrantages  aad  disadrantages  of  those 
algorithas,  it  is  first  bast  to  asks  soaa  gaaaral  coaaaats  aad  define 
soaa  aotatioas.  All  of  tha  algorithas  have  reeursire  equations.  That 
is,  either  the  aqaatioa  for  tha  aoraalisiag  ooaataat  or  soaa  other 
paraaatar  is  girea  ia  taras  of  tha  saaa  paraaatar  with  one  lass 
cnstoaer  ia  tha  systaa,  Mora  precisely,  oaa  lass  oastoaar  ia  one  of  tha 
chaias.  For  a  network  with  J  elosad  ehaias  let  V  -  (V1,V2,,..,Vj)  where 
Vj  is  tha  asabar  of  esstoaars  ia  tha  jth  ohaia.  Tha  rector  V  will  be 
referred  to  as  tha  population  rector.  Now  let  lj  be  a  rector  with  a  one 
in  tha  jth  eoaponent  and  xaros  ererywhsre  also.  Thus,  the  rector  V-lj 
represents  tha  network  with  one  lass  cnstoaer  ia  chain  j. 

Tha  oonrolntion  algoritha  was  darelopad  by  Bnsen  in  the  early 
1970's  [BOZE73].  Its  naae  coaas  froa  fact  that  tha  recurrence  equation 
for  G(V)  resaablas  discrete  oonrolntion.  In  the  case  of  s  single  chain 
closed  network,  G(0)  is  assigned  the  ralne  of  one.  This  ralne  is  used 
to  coapnte  G(l),  tha  noraalizing  constant  when  there  is  one  cnstoaer  in 
the  systea.  The  ralne  of  G(l)  is  then  nsed  to  coapnte  G(2)  and  so  on. 


The  process  is  rspsstsd  until  the  dssirsd  popnlstion  has  bssn  reached. 
For  a  single  chain  network  with  N  serwiee  centers*  the  algoritha 
requires  approxiaately  N+V  anl  t  ipl  ications  and  N+V  additions. 
Unfortunately*  the  algoritha  is  sensitive  to  the  value  that  aust  be 
assigned  to  one  of  e's,  and  nnaerical  probleas  ean  ooour  regardless  of 
what  value  is  assigned  (usually  overflow).  In  addition*  the  eoaplexity 
of  the  algoritha  increases  significantly  for  networks  with  aultiple 
chains.  The  details  of  the  algoritha  will  not  be  discussed  here  due  to 
the  laok  of  rooa  and  the  fact  it  is  discussed  elsewhere.  The  interested 
reader  is  referred  to  'Coaputational  Algorithas  for  Closed  Queueing 
Networks'  by  Bruell  [BRUE80].  This  reference  is  a  condensed  version  of 
his  Ph.D  dissertation.  It  contains  over  200  pages  and  starts  with  the 
equations  developed  in  the  previous  chapter  .  Approxiaately  two-thirds 
of  the  book  is  devoted  to  this  one  algoritha. 

In  the  late  1970's  Reiser  and  Lavenberg  developed  an  iterative 
algoritha  that  can  deteraine  aean  perforaanee  values  without  finding 
the  noraalizing  constant  [REIS80],  Bence*  the  naae  Mean  Value  Analysis. 
For  single  chain  networks  the  aean  values  are  deterained  for  the 
network  with  one  custoaer.  These  values  are  used  to  deteraine  the  assn 
values  of  the  network  with  two  custoaers*  and  so  on.  The  algoritha 
requires  approxiaately  the  saae  nuaber  of  ooaputations  and  storage  as 
the  convolution  algoritha,  however  it  is  less  sensitive  to  nnaerical 
probleas.  It  is  the  algoritha  of  choice  except  for  networks  thst 
contain  several  service  centers  with  'limited  load  dependent’  service 
rates  (See  Chapter  6,  Section  6.5.6)  [BRUE 80]  [LAVES*]  [HATE 84].  In 


addition  it  is  the  only  algorithm  whose  equations  have  intuitive 
meanings.  This  not  only  makes  it  easier  to  explain,  bat  more 
importantly,  easier  to  remember.  For  these  reasons  and  beoanse  there 
exist  no  examples  in  the  literature,  it  will  be  discussed  here. 
However,  it  will  not  be  discussed  with  the  same  mathematical  rigor  as 
the  previous  chapters.  There  are  several  reasons  for  this.  The  first  is 
that  many  of  the  proofs  employ  results  that  are  from  the  convolution 
algorithm,  which  would  have  to  be  explained  and  derived  also.  Another 
reason  for  not  deriving  all  of  the  equations  is  that  this  would 
conflict  with  presenting  the  material  in  a  tutorial  fashion,  which  is  a 
primary  objective.  That  is,  many  of  the  simplest  to  use  equations  are 
special  casea  of  more  general  equations,  and  they  cannot  be  derived 
without  first  deriving  the  more  general  ones. 

LBANC  was  inspired  by  MVA  and  closely  parallels  it  [CHAN80].  In 
addition  to  determining  the  mean  performance  values,  the  normalizing 
constant  is  also  determined  as  implied  in  its  name.  It  is  the  algorithm 
of  choice  when  probability  distributions  are  required.  However,  it  has 
the  same  numerical  stability  problems  as  the  convolution  algorithm, 
and  the  same  disadvantages  as  MVA  when  dealing  with  limited  load 
dependent  service  rates.  Another  disadvantage  is  that  its  equations  do 
not  have  intuitive  meaning  and  are  difficult  to  remember.  Vith  the 
exception  of  a  few  comments,  LBANC  will  not  be  discussed  further. 

7.2  Closed  Networks 

For  a  closed  network,  the  complexity  of  determining  the 
performance  metrics  is  directly  proportional  to  the  number  of  feasible 
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network  states,  end  ss  stated  in  the  last  chapter  the  nnaber  of 
feasible  ne?w_prk  states  can  significantly  be  rednced  by  eliainating 
classes  and  distinguishing  between  cestoaers  according  to  chains. 
Although  this  is  the  starting  point  of  all  algorithas  for  closed 
networks,  the  snthors  of  these  algorithas  state  this  in  very  obscnre 
ways.  For  ezaaple  Reiser,  the  author  of  the  MVA  algorithm,  siaply 
states  that  a  network  that  allows  cnstoaers  to  switch  classes  can  be 
aapped  into  a  aodel  without  class  changes  [REIS80].  Although  this 
stateaent  aight  be  iaplied  in  the  reference  he  gives,  there  is  no  such 
stateaent  in  the  paper.  Bruell  starts  transforaing  the  classes  into 
what  he  called  equivalent  classes  without  giving  a  reference  or 
justification  for  doing  so  [BRUE80].  In  addition,  several  of  Bruell’s 
stateaents  and  equations  concerning  obtaining  olass  Metrics  froa 
equivalent  class  aetrics  are  wrong.  Chandy  and  Sauer,  the  authors  of 
LBANC,  aake  the  stateaent  that  it  is  aore  convenient  to  first  obtain 
aetrics  by  service  centers  and  then  obtain  class  aetrics  froa  these 
(their  stateaent  as  given  is  valid  only  for  single  chain  networks) 
[CHAN80],  Again,  they  give  no  reference  or  justification.  In  addition, 
aany  of  the  authors  that  have  aade  extensions  or  aodifications  to  the 
original  algorithas  aake  stateaents  such  as  each  chain  j  custoaer 
belongs  to  the  saae  custoaer  class,  or  that  the  tera  class  and  chain 
are  used  synonyaously.  They  aake  no  aention  of  the  fact  that  the 
original  algorithas  or  their  Modified  ones  can  handle  networks  in  which 
oustoaers  are  allowed  to  change  classes.  It  is  believed  that  at  least 
part  of  the  confusion  arises  froa  the  feet  that  there  is  no  reference 


explicitly  explaining  this.  More  precisely,  it  is  believed  that  the 
state  in  which  cnstoaers  are  distinguished  according  to 
chains,  along  with  its  jnstif ieation  given  in  the  previous  chapter,  is 
not  new  but  does  not  appear  (at  leaat  explicitly)  elsewhere  in  the 
literature. 

Conaidering  the  problea  at  hand,  once  the  chain  perforaance 
aetrics  have  been  deterained,  clasa  perforaance  aetrics  can  be  easily 
calculated.  For  exaaple,  once  the  noraalizing  constant  has  been 
deterained  its  veins  can  siaply  be  substituted  into  the  equation  for 
probability  distribution  by  class.  Before  deriving  the  equations  for 
converting  chain  perforaance  aetrics  to  chain  aetrics,  a  notational 
change  will  be  introduced.  The  aean  service  rates  of  a  class  c  or  chain 
j  custoaer,  denoted  jiie  and  pjj  respectively,  aore  often  than  not  have 
appeared  in  their  reciprocal  fora.  Therefore,  let 

i/hic  "  sic  (7*1) 

l/|»ij  ■  Cjj  .  (7.2) 

Obviously,  sic  and  s^j  are  the  aean  service  tines  of  a  class  c  and 
chain  j  custoaer  at  service  center  i.  The  equations  for  deteraining 
aean  class  aetrics  froa  aean  chain  aetrics  and  their  derivations 
follow: 

Throughput  by  class  can  be  deterained  froa  the  known  relative 
throughputs  e^0  and  e^j.  More  precisely, 

Tic<v>  "  (•ic/*ij>  Tij<v>  •  <7-3> 

Utilization  by  class  can  be  deterained  froa  the  equation  : 

PiC<V>  “  «*ic*ic>'<*ij'ij>1  pij(V)  • 


(7.4) 


which  follows  from  the  reasoning  that  since  the  e's  are  relative 
throughputs,  «^e*£e  ande^s^  are  relative  utilizations.  Similarly, 
the  aean  nuaber  of  class  c  customers  at  service  center  i  is  given  by  : 

Llc(V)  -  I(*iC»ic)/(»ij«ij>l  WjOT)  .  (7.5) 

which  follows  froa  the  fact  that  the  tera  in  brackets  (the  ratio  of 
relative  utilizations)  is  the  conditional  probability  that  an  arbitrary 
custoaer,  waiting  for  service  or  already  receiving  service,  is  in  class 
c,  given  that  it  is  in  chain  j.  Class  response  tiae  can  be  calculated 
froa  Little's  law.  More  precisely, 

Ric(V)  “  Lio(V)/Tic(V)  *  (7.6) 

7.2.1  The  Arrival  Theorem 

Mean  performance  paraaeters  for  a  queueing  network  with  multiple 
closed  chains  and  a  product  fora  solution  can  be  determined  from  the 
three  principles  : 

(1)  A  chain  j  custoaer  arriving  at  service  center  i  'sees'  the  system 
with  himself  removed  and  in  equilibrium, 

(2)  Little's  Law  applies  to  chains, 

(3)  Little's  Law  applies  to  service  centers. 

The  first  of  the  these  principles  is  known  as  the  srrival  theorem.  It's 

proof,  [LAVE79],  depends  on  results  thst  csn  only  be  derived  from  the 

r 

convolution  algorithm  and  will  not  be  repeated  here.  It  is  important  to 
emphasize  that  the  arrival  theorem  only  holds  for  networks  that  have  a 
product-fora  solution.  Most  of  this  chapter  is  concerned  with  the 
spplication  of  these  three  principles. 


Aa  its  name  implies,  MVA  deals  with  determining  the  mean  values  of 
performance  metrics  snoh  as  throughput,  response  time,  and  customer 
distribution.  However,  it  is  possible  to  determine  the  normalizing 
constant  from  these  values  via  the  throughput  theorem.  It  states  that 
the  average  throughput  of  a  chain  j  customer  through  service  center  i 
is  : 


Tij<V> 


OtV-lj) 

G(V) 


•ij 


(7.7) 


where  G(V-lj)  is  the  normalizing  constant  of  the  network  with  one  less 
customer  in  chain  j.  The  throughput  theorem  is  one  of  the  primary  ~ 
results  of  the  convolution  algorithm  and  will  not  be  proven  here. 
Solving  this  equation  for  G(Y)  results  in 


G(V) 


G(V-lj) 


•ij  . 


(7.8) 


Now,  since  e^j  is  known  and  MVA  requires  the  calculation  of  T^j(V)  for 
all  V  up  to  the  desired  population,  G(V)  can  easily  be  determined.  The 
procedure  will  be  illustrated  later  by  examples.  Unfortunately,  this 
step  does  add  to  the  storage  requirement  of  the  algorithm.  This  may  or 
may  not  be  an  issue  depending  on  the  size  and  population  of  the  network 
and  the  amount  of  usable  memory. 


At  this  point  some  additional  comments  shout  the  normalizing 
constant  are  appropriate.  As  of  the  present  there  is  no  algorithm  or 
scaling  technique  that  will  always  prevent  overflow  from  occurring  when 


trying  to  calenlate  tho  noraalixing  constant.  On#  of  the  priaary 
advantages  of-  MVA  om  convolution  and  LBANC  is  that  it  doesn't 
require  the  noraalixing  oonstant  to  obtain  perforaanoe  aetriea. 

7.2.3  Sinale  Chain  -  Load  Independent  -  Closed  Networks 

In  order  to  illnetrate  the  MVA  algoritha  consider  a  single  chain 
closed  network  with  N.  load  independent,  single  server,  FCFS,  service 
centers.  Clearly,  the  aean  tiae  a  cnstoaer  stays  at  a  service  center  is 
his  aean  servioe  tine  pins  the  aean  tine  it  takes  for  the  service 
oenter  to  dispose  of  the  backlog  of  cnstoaer  ahead  of  it.  Since  the 
aean  service  tiae  of  all  onatoaers  at  service  oenter  i  is  the  saae,  the  - 
aean  response  tiae  of  a  onstoaer  at  servioe  center  i  is: 

Mt(V)  -  st  Cl  +  Lt (V-l ) 1 ,  (7.9) 

where  the  tera  Lj(V-l)  is  the  average  backlog  of  enstoaers  and  follows 
directly  froa  the  arrival  theorea. 

Throughput  can  now  be  calculated  froa  response  tiaes  by  the 
equation: 

Ti(V)  -  V  /  ^  (ea/ei)  R^V)  .  (7.10) 

n-1 

The  equation  for  throughput  follows  froa  the  fact  that  (eB/e^)  is  the 
nuaber  of  tiaes  a  cnstoaer  visits  service  center  n  before  returning  to 
service  center  i,  and  therefore  the  suaaation  is  the  tiae  it  takes  a 
cnstoaer  to  pass  through  service  center  i  and  return. 

The  aean  nuaber  of  enstoaers  at  each  service  center  can  now  be 


s' 

s" 

s' 
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celculeted  fro*  Little'*  lew.  More  precisely  : 


L^V)  -  T^V)  R^V)  .  (7.11) 

Thus,  R^O),  Tj(0),  end  L^(0)  cen  be  celouleted  end  these  velues  used 
to  deteraine  Rt(l),  Tjd),  Li(l)»  the  results  used  to  deteraine  the 
perforaence  aetrics  for  V-2  end  so  on.  At  eny  point  in  the 
celculetions.  the  utiliietion  of  the  service  center  cen  be  celculeted 


P j  (V)  -  s,  T4(V). 


(7.12) 


Although  it 


id  thet  ell  service  centers  were  loed 


independent  FCFS,  the  equetions  ere  velid  elso  for  lord  independent  PS 
end  LCFSPR  service  centers.  This  follows  froa  the  feet  thet  the 
stete  probebilities  ere  the  seae,  end  consequently,  so  ere 
the  aeen  perforaence  aetrics.  The  infinite  server  cese  is  triviel.  Thet 
is.  since  the  nuaber  of  servers  is  elweys  greeter  then  or  equel  to  the 
nuaber  of  custoaers,  the  aeen  response  tiae  is  just  the  aeen  service 
tiae.  A  aore  progrea-like  definition  of  the  elgoritha  is  given  in  Teble 
7.1.  Notice  thet  the  throughputs  for  ell  but  one  of  service  centers  ere 
obteined  froa  their  reletive  throughputs. 

As  en  ezeapl*.  the  closed  network  of  Figure  5.7  will  be  reworked 
using  MV  A.  For  convenience,  servioe  retes  end  reletive  throughputs  ere 
repeeted  here: 


s^  -  10ns 


*2  “  25*8 


s3  -  lOOas 


ex  -  100 
ej  ”  80 

e3  -  10  . 


WWW 


risviv.v.1 


WOWS’ 


Bagla 

For  i:«l  to  N  do  {Initialization} 
LjCO)  :•  0 

For  vH)  to  V  do  {body} 

bagin 

{raaponsa  tine} 

For  !:■!  to  N  do  (raapoaaa  tiaa) 


R^V) 


C •l  [1  +  L1(V-1)]  if  i  FCFS,  PS,  LCFSPR 
L*4  if  i  IS 


(tbrongbpnt) 

T4(v)  *  ^  #j  Ij(t) 

J-l 

For  i:«2  to  N  do 

TjCt)  •  (Oj/Oj)  T^v) 


{queue  length} 

For  i:»l  to  N  do 

L^V)  -  T^V)  RjCV) 

end  (KVA  body} 


{utilization} 

For  i:-l  to  N  do 


P4(V) 


{ 


•4  TjCV) 
0 


if  i  FCFS,  PS,  or  LCFSPR 
if  i  IS 


End 


♦  t.r-j 


■>  mA  i  > 


Calculations  for  ▼  ■  1 


*j(l)  -  (10*10-3)  (1) 

^(l)  -  (25*10~3)  (1) 
RgCl)  -  (100*10-3)  (1) 


(1)  (100) 


(100) (10*10  *)  +  (80) (25*10  *)  +  (10) (100*10  *) 
T2(l)  -  (80/100)  Tjd)  -  20 
T3(l)  -  (10/100)  Tj(l)  -  2.5 

Lj(l)  -  (25)  (10*10-3)  -  0.25 
Lj(l)  -  (20)  (25*10“3)  -  0.50 
L3(l)  -  (2.5)  (100*10“3)  -  0.25  . 


Calculations  for  ▼  -  2  : 

Rj(2)  -  (10*10~3)  (1.25)  -  12.5*10"3 
RjU)  -  (25*10-3)  (1.5)  -  37.5*10“3 

^(2)  -  (100*10“3)  (1.25)  -  125*10~3 

(2)  (100) 


(100) (12.5*10  ')  +  (80) (37.5*10  ')  +  (10)(125*10  ') 
T2(2)  -  (80/100)  Tj(2)  -  29.09 
T3(2)  -  (10/100)  Tx(2)  -  3.636 

Lj(2)  -  (36.36)  (12.5*10~3)  -  0.445 
Lj(2)  -  (29.09)  (37.5*10-3)  -  1.091 
L,(2)  -  (3.636)  (125*10-3)  -  0.445  . 


\rsrA 


Calculations  for  ▼  *  3 


EjO)  -  (10*10-3)  (1.455)  »  14.55*10~3 


EjO)  -  (25*10~3)  (2.091)  -  52.28*10" 


£3(3)  -  (100*10~3)  (1.445)  -  145.5*10-3 


(3)  (100) 


(100) (14. 55*10  *)  +  (80X52. 28*10  ')  ♦  (10) (145.5*10  *) 


T2(2) 

T3(2) 


(80/100)  T2(3)  -  33.84 
(10/100)  Tj(3)  -  4.23 


4(3)  -  (42.3)  (14.55*10~3)  -  0.4155 

Lj(3)  -  (33.84)  (52.28*10“3)  -  1.749 


L3(3)  -  (4.23)  (145.5*10-3)  -  0.4155 


Pl(3)  -  (10*10-3)  (42.3)  -  0.423 
p2(3)  -  (25*10-3)  (33.84)  -  0.844 


p3(3)  -  (100*10“3)  (4.23)  -  0.423 


If  desired  the  normalizing  constants  can  now  ba  calculated  fron 


the  throughputs.  More  precisely. 


Q(V-l)  - 


T2(V) 


G(0)  -  1  , 


(1) (100)  . 

G(l)  -  - — -  -  4  , 

25 


*,«  V  V  *  ,  •  v*  *v'  V  str*/\ 


1 


(11X100) 

G(3)  -  - - —  ■  26 

42.3 


■UAl  AAi 


Let  s^k^)  equal  l/|ii(ki).  For  service  centers  with  Halted  load 


dependent  servioe  rates  the  average  response  is  obtained  froa: 


»i(V)  -  )  ^  si(k1)  P^ki-llv-l)  . 


(7.13) 


where  P^kj-llV-l)  is  the  asrginal  probability  of  finding  ki~l 


cnstoaers  at  service  center  i.  given  that  the  network  contains  V-l 


cnstoaers.  It  can  bo  deterained  froa  the  recurrence  equation: 


PXk.lV) 


for  kj*0  and  V-0 


•l<ki}  Ti(V)  Pi(ki-llV-l)  for  kt>0 


1  -  2  Pi<kilV) 

ki"° 


for  kj-0  and  V>0  . 


(7.14) 


Note  that  the  equation  for  the  response  tiae  holds  even  if  the  service 


rate  is  fixed  or  if  it  is  strictly  load  dependent  (infinite  servers). 


Although  it  will  not  be  proven  here,  the  equation  for  the  asrginal 


probability  also  holds.  The  reason  for  this  is  that  both  equations  are 


interaediate  step*  in  the  proof  of  the  arrival  theorea.  More  precisely, 
the  e qua t loss  for  anltiple  chain  load  dependent  service  centers  (the 
aoet  coaplez  case)  are  derived  first  and  all  the  others  froa  these. 
The  ntilization  then  of  a  United  load  dependent  service  center  is  : 


Pi(V)  -  2  ■i*(ki.»i>  ^i(kilV)  /  «i  •  (7.15) 

ki-° 

This  follows  froa  the  fact  that  when  service  center  i  contains  k^ 
cnstoaers,  [ain(k^,a1)]/a1  is  the  capacity  of  the  aervice  center  that 
is  being  need. 

The  procedure  will  be  illustrated  by  the  network  in  Pigure  7.1.  A 
description  of  the  service  centers  is  given  in  Table  7.2.  It  follows 
froa  the  routing  probabilities  in  Figure  7.1  that  if  e2  is  assigned  the 
value  of  one,  then  "  *3  "  0.5.  Thus, 

T2(V)  -  (ej/ej)  TX(V)  -  (2)  T2(V)  for  all  V 

T3(V)  -  (ej/ej)  T2(V)  -  (1)  Tj(V)  for  all  V. 

It  follows  froa  the  service  rates  of  the  individual  servers  that: 


•l 


2 


*2 


1 


*3(ki) 


{ 


4  for  k^l 
2  for  k^>l  . 


The  following  are  the  calculations  for  v*»l ,  v*2,  and  v-3: 


Service 

Noaber  of 

Service 

Server 

Cents r 

Servers 

Discipline 

Rate  (ij 

w 

1 

PS 

0.5 

2 

m 

IS 

1 

3 


2 


FCFS 


25 


1^(2)  -  (0.235)  (2.5)  -  0.588 
Lj(2)  -  (0.471)  (1)  -  0.471 

L3(2)  -  (0.235)  (4)  -  0.940 

P3(l|2)  -  (4)  (0.235)  P3(0|l)  -  0.470 
P3(2(2)  -  (2)  (0.235)  P3CI ll>  -  0.235 
P3(0|2)  -  1  -  (0.470  +  0.235)  -  0.295  . 

Calculation*  for  v>3 
Rj(3)  -  (2)  (1.588)  -  3.176 
8j(3)  -  1 

^(3)  -  (1) (4)  P3(0|2)  +  (2) (2)  P3(l|2)  +  (3) (2)  P3(2|2) 

(0.5)  (3) 


[Ml 


[Ml 


P2(3)  -  (0.311)  (2)  -  0.522 
p2(3)  »  0 

P3(3)  -  [(1X0.377)  ♦  (2)(0.292)  +  (2) (0.146) ] /2  -  0.622 


A*  before,  the  throughput  theorem  ots  be  used  to  determine  the 


normalising  constant: 


G(0)  -  1  , 


(1)  (0.5)  , 

G<1)  *  -025“  "  4  * 


(4) (0.5) 


0.235 


(8.5) (0.5) 


0.311 


-  13.667 


The  calculations  for  load  dependent  service  centers  not  only 


require  additional  work,  but  also  require  additional  storage  to  compute 


the  marginal  probabilities. 


The  single  chain  MVA  algorithm  described  in  the  previous  tvo 


sections  generalises  directly  into  a  multiple  chain  algorithm.  For 


Networks  with  load  independent  or  type  IS  service  centers,  the 


recurrence  equations  are: 


Eij(V)  - 


•ij  11  +  mv-lj)]  for  i  FCFS,  PS  or  LCFSPR 


for  i  IS 


(7.16) 


LiJ(v>  "  Tij(v)  Eij(v) 

Lj(V)  -  \  L4j(V)  . 
j-1 


(7.18) 


(7.19) 


The  relationships  szprssssd  by  the  equations  shonld  be  obvious 
fro*  the  earlier  diaousaion  with  the  possible  exception  of  the  equation 
for  response  tine.  That  it,  one  night  suspect  that  since  custoaers  in 
different  chains  nay  have  different  service  rates  if  the  discipline  is 
PS  or  LCFSPK,  the  equations  should  soaehov  account  for  this.  However, 
the  equation  is  oorrect  as  stated,  and  the  authors  of  the  algorithn 
siaply  state  that  Sjj  L^V-lj)  is  a  congestion  factor  caused  by  the 
other  custoaers.  In  the  case  of  FCFS  service  centers,  it  is  required 
that  *iia*i2a>  •••  "*jj  **B0*  HVA  is  only  valid  for  networks  that  have 
product  fora  solutions.  A  prograa-like  definition  of  the  algoritha  is 
given  in  Table  7.3.  Notice  that  the  nuaber  of  iterations  has  increased 
significantly  due  to  aultiple  chains.  As  before,  utilization  can  be 
calculated  at  any  point  in  the  procedure  by  the  equations: 


•  Vs-  '• 
.-V\V 

>>  ' 
-SVv 


»  "  n  **  to 


i 


*  * 
w*1  -  *  * 


Begin  {initialization 


for  i:*l  to-N  do  1^(0)  :■  0 

for  Vj:*©  to  Vj  do 
for  V2:“®  to  ^2  do 
•  •  • 

for  Vj:«0  to  Vj  do 
begin  {aain  body} 

▼  -  (▼1#v2» 

for  j :-l  to  J  do 

for  i:»l  to  N  do  {responee  time) 


,Vj) 


fa,,  [1  +  L,(y-1,)]  for  i 

"i  , 

L»ij  for  i 

{ throughput} 

Tlj(v)  -  ®ij  vj  /  «ij  Rij(r) 


FCFS,  PS,  LCFSPR 
IS 


for  i:-2  to  N  do 

Tij(v)  -  (oy/ou)  lyU) 
for  i:~l  to  N  do  {chain  queue  length} 

Lij(v)  “  Tij(v)  Rij(v) 
end  {for  j} 

for  i:»l  to  N  do  {queue  length} 


end  end  end  {for  *  *  *  »vj) 

{calculate  utilization} 


End 


In  order  to  illustrate  the  aultiple  chain  procedure,  consider  the 

network  in  Figure  7.2  and  the  description  of  the  service  centers  given 

in  Table  7.4.  Assigning  e3  j  -  ^2, 2  “ 

1  yields: 

*1,1  “  °*5 

*1,2  “  0,5 

*2,1  "  °*5 

*2,2  "  0,5 

*3.1  “  1 

*3,2  "  1  * 

Thus, 

T2,1<V>  “  T1,1<V> 

T2.2<V>  *  T1.2(V> 

T3,1(V)  “  <2)  T1.1(V) 

T3f2(V)  -  <2)  T1#2(V), 

for  all  V. 

It  follow  froa  Table  7.4  that  : 

*1,1  "  2 

•1.2  "  2 

*2,1  “  4 

*2.2  “  2 

*3.1  “  1 

*3,2  "  2  * 

The  following  are  the  calculations  up 

to  V«(2,2)  : 

Calculations  for  v  -  (0,1) 

RjjtO.l)  -  2 

®2,2<®»1>  "  2 

Rj.jCO.D  -  2 

_ _  (0.3)  <1) 

4%  saw 

(0.5)(2)+(0.5)(2)+(l)(2) 


V.'V 


CHAIN  1 


CHAIN  2 

Figure  7.2  Loud  Independent,  Multiple  Che in  Cloeed  Network 


Service 

Nuaber  of 

Service 

Server 

Server 

Center 

Servers 

Discipline 

Rate  |»i3L 

lute  p12 

TO 


Lj  ^d.O)  -  JO. 125)  (2)  -  0.25  -  Lj(l,0) 

Lj  ^d.O)  -  (0.125)  (4)  -  0.50  -  Ljd.O) 

L3,l(1»0)  “  «>*25)  (1)  -  0.25  -  Ljd.O)  . 

Calculations  for  ▼  -  (1.1) 

Ej^d.l)  -  (2)  (1.25)  -  2.5 
R2#1(l.l)  -  (4)  (1.25)  -  5 
Rj  ld.D  -  1 

_ (0.5)  (1) _ 

i'1'  *  '  "  (0.5)(2.5)+(0.5)(5)+(l)(l)  " 

Tj  id.D  -  0.105 

T3,l(1,1)  “  °*210 

Lj  jd.l)  -  (0.105)  (2.5)  -  (0.243) 

Lj  jd.l)  -  (0.105)  (5)  -  (0.526) 

L3j1(1,1)  -  (0.210)  (1)  -  (0.210) 

R1#2(l.l)  -  (2)  (1.25)  -  2.5 
*2 <2d.l)  -  <2)  (1.5)  -  3 

*3.ld'l)  *  2 

_ (0.5)  (1) _ _ 

1.2a*1)  "  (0.5)(2.5)+<0.5)(3)+(l)(2)  " 

T2 #2(1.1)  -  0.105 

T3,2(1*1)  "  0,211 


224 


Lj#2(1.1)  -  (0.105)  (2.5)  -  0.263 
Lj  jd.l)  -  «T.105)  (3)  -  0.315 


L3,2(1'1)  “  «>.211)  (2) 


0.422 


Lj(l, 1)  -  (0.263)  +  (0.263)  -  0.526 

Ljd.l)  -  (0.526)  +  (0.315)  -  0.841 

L3(l,l)  -  (0.210)  +  (0.422)  -  0.632 


Calculations  for  ▼  «  (1,2)  : 


Rjfl(l,2)  -  (2)  (1.556)  -  3.112 
Rj  jd.2)  -  (4)  (1.556)  -  6.224 

*3.1(1'2)  "  1 


T1,1<1'2) 


(0.5)  (1) 


(0.5) (3. 112)+ (0.5) (6.224 )+(l) (1) 


-  0.088 


T2,l(1'2)  “  °-088 


T3#ld.2)  -  0.176 


L.  ,(1.2)  -  (0.088)  (3.112)  -  0.274 


Lj^d.2)  -  (0.088)  (6.224)  -  0.548 
L3,l(1*2)  *  (0.176)  (1)  -  0.176 


R1.2(1»2)  “  (2)  <1*526)  -  3.052 


822(1,2)  -  (2)  (1.841)  -  3.682 
*3.2(1'2)  "  2 


*.  -V  “V 

*v  A 

"•  V  v 

w  *  ji  V  1 


Piy, 

•Nv-*. 

i 


’-.yy 

r.  a.  * 


m  *  M  +  L  * 


-%y  *, 


■Stt* 


Cftlealttioaa  for  r  "  (2,1)  : 
1*^(2. 1)  -"(2J  (1.320  -  3.052 
R2#1(2.1)  -  (4)  (1.S41)  -  7.344 

B2,l(2.1)  -  1 


•r  fl  H 

(0.5)  (2) 

(0.5) (3.052)+(0.3) (7.364) +(1)(1) 

T2,i(2.1) 

0.161 

T3,l(2,l) 

0.322 

Ll,l(2*1) 

(0.161)  (3.052)  -  0.492 

L2#l(2,l) 

(0.161)  (7.364)  -  1.186 

L3,i(2.D 

(0.322)  (1)  -  0.322 

*1.2<2.1> 

(2)  (1.475)  -  2.950 

(2)  (2.143)  -  4.286 

R3,2(2*1> 

2 

-  0.161 


T  (5  1  \  a 

(0.5)  (1) 

f 

o 

• 

u 

M 

• 

950)+(0. 5) <4.286)+(l) (2) 

T2,2(2*1)  1 

■  0.089 

T3.2(2.l)  ■ 

•  0.178 

l1,2<2.1>  ■ 

•  (0.089) 

(2.950)  -  0.263 

^2.2(2.!)  • 

■  (0.089) 

(4.286)  «  0.381 

L3.2*2,1*  * 

-  (0.178) 

(1)  -  0.356 

-  0.089 


«■ .  - 

•Vv< 


VA 

•'I-V 

v> 

> 

?v. 

V  a 

\V> 

VA.V 


:- v:>:ys  v%y' 


LjU.l)  -  0.491  +  0.263  -  0.754 
LjU.l)  -  1.186  +  0.381  -  1.567 
Lj (2,1)  -  0.322  +  0.356  -  0.678 

Caleulitioii*  for  ▼  -  (2,2)  : 
1^(2, 2)  -  (2)  (1.842)  -  3.684 
*2^(2, 2)  -  (4)  (2.233)  -  8.932 
*31(2,2)  -  1 


(0.5)  (2) 


(0.5) (3 . 684)+(0. 5) (8.932)+(l) (1) 

0.137 

0.274 


(0.137)  (3.684)  -  0.504 
(0.137)  (8.932)  -  1.222 


(0.274)  (1) 


0.274 


(2)  (1.754)  -  3.508 
(2)  (2.567)  -  5.134 


(0.5)  (2) 


I 


(0.15S)  (3.508) 


4.2<2*2> 


(0-.158)  (5.134) 
(0.316)  (2) 


4(2.2) 

4(2.2) 

4(2,2) 


0.504  +  0.555 
1.222  +  0.812 
0.274  ♦  0.633 


1 


2.1 


0 


Utilisation  Calculations  : 
P1#1(2.2)  -  (2)  (0.137) 
p2,1(2»2)  "  (4)  <0*137) 
p3,1(2*2)  "  0 


p1,2(2*2)  “  (2)  <0*158) 
P,  ,(2.2)  -  (2)  (0.158) 


|  G(1,0) 

i 

I 

i 

j  G(l.l) 

0(1,2) 

I  G(2,0) 


(1)  (0.3) 
0-.125 


(4)  (0.3) 
0.105 


19.048 


(9.009)  (0.5) 
0.088 


51.188 


(4)  (0.5) 
0.190 


10.528 


0(2,1) 


(19.048)  (0.5) 
0.181 


59.1552 


G(2.2) 


(51.188)  (0.5) 
0.137 


188.818  . 


This  problem  demonstrates  the  primary  reason  why  there  are  no 
examples  of  MVA  in  open  literature,  and  very  few  examples  of  the  other 
algorithms.  Simply  put,  they  are  just  too  longl  In  addition,  the 
calculations  are  iterative  in  nature  and  best  done  by  a  computer.  The 
problem  is  that  if  one  does  not  understand  how  to  apply  the  algorithm, 
then  they  would  not  be  able  to  write  a  computer  program  to  do  the 
calculations. 

Appendix  B  is  the  listing  of  a  computer  program  for  multiple 
chain,  load  independent,  closed  networks.  The  code  was  written  in  Tnrbo 
Pascal,  and  is  for  an  IBM  PC  or  compatible  computer.  The  program 
assumes  that  there  is  only  one  class  of  customers  per  chain.  Therefore, 


SKA 


if  there  are  multiple  classes  per  chain,  the  users  must  merge  these 


into  an  equivalent  class  (See  Chapter  6,  Section  6.5.3  where  customers 
are  distinguished  according  to  chains  rather  than  class).  In  addition, 
the  nser  nnst  calculate  the  relative  thronghpnts  and  supply  then  to  the 
program.  It  is  nsnally  trivial  to  find  the  relative  throughputs,  and  it 
was  felt  that  this  would  be  better  than  prompting  the  user  for  the 
routing  probabilities  (there  are  always  more  routing  probabilities  than 
throughputs) . 


7.2.6  Load  Dependent  -  Multiple  Chain  -  Closed  Networks 

As  before,  for  service  centers  with  limited  load  dependent  service 
rates,  the  equation  for  the  response  time  is  in  terms  of  marginal 
probabilities.  More  precisely, 

IXi 

*ij(V)  -  )  hi  siJ(ki)  Pi(ki-l|V-lj)  ,  (7.22) 

where  |v|  -  •••  +Vj,  and 


1  for  kj«0  and  |v|*0 

Pi(ki|V)  ^  «ij<ki>  Tij(V)  Pi(ki-l|V-lj)  for  kjX)  and  |v| >0 

j-1 


L  1  -  T Pi(kilV) 


kf-1 


for  k$»0  and  I V| >0. 

(7.23) 


Also  as  before,  these  same  recursive  equations  apply  to  service 
centers  that  are  load  independent.  In  order  to  illustrate  their  use,  s 
second  server  will  be  added  to  service  center  one  of  the  previous 
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' 


V  V  V.V VV.V-V 


nultiple  chain  ezanple  and  the  problen  reworked.  The  input  paranetera 
for  the  node-1  are: 


•l.l  •  °-5 

e1.2  " 

0.5 

*2.1  "  °*5 

*2.2  “ 

0.5 

*3.1  "  1 

*3.2  * 

1 

Cl  for  k.*l 

Cl  for 

ki-1 

*1  2(ki* 

f  \l  for  kj>l 

*1.2(ki>  " 

u 

o 

r 

ki>l 

*2,2  “  4  *2,2  "  2 

*3.2  *  1  *3,2  "  2 


T2,1(V)  "  (®2.1/el.l)  Tl,l(Vr  "  (1)  T1,1(V) 

T3.1<V>  “  <*3.l'»l.l>  T1.1<V>  "  <2>  T1.1<V> 

T2.2<V>  *  <*2.2'*1.2>  T1.2<V>  “  <l>  T1.2<V> 

T3.2(V)  *  (e3.2/*l,2)  T1,2(V)  *  (2)  T1,2(V)  * 


Calculations  for  ▼  ■  (0.1)  : 

Rj ,2(°.1>  “  *l,2(1)  pi<0i0»0) 

-  (1)  (2)  (1)  -  2 
*2  2(0.1>  -  (2)  (1)  -  2 
RgjCO.l)  -  2 


Tit2(0.1) 


_ (0.5)  (1) _ 

(0.5) (2)  +  (0.5) (2)  +  (1)  (2) 


0.125 


X2,2(0*1)  "  (1)  <°*125>  "  0.125 
T3,3(0»1)  *  <2)  <°*125>  "  °*250 
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v  v^rwur?uronQnuTOnnHaflnJOT*vin/iruw»TOrij«wOTwi  i»nj«n  «n  ^  *n  ^  v, 


Lj  2(0,1) 

4,1(0'1> 


L31(0.1) 


P^llO.l) 


PjCOlO,!) 


Calculations  for  ▼  *  (0,2) 


(0.125)  (2)  -  0.25  -  4(0.1) 
(0-.125)  (2)  -  0.25  -  ^(O.l) 
(0.250)  (2)  -  0.50  -  4(0,1) 


•l,2(1)  T1.2(0'1>  PiWlO.O) 
(2)  (0.125)  (1)  -  0.25 
1  -  0.25  -  0.75. 


4#2(0.2) 

*2.2<°'2> 
*3,2 (0*2) 

(1)  a2  2(1)  P1(0|0.1)  +  (2)  *lf 

(1)  (2)  (0.75)  +  (2)  (1)  (0.25) 

(2)  (1.25)  -  2.5 

2 

(0.5)  (2) 

* i ^  2' • * 

(0.5) (2)  +  (0.5) (2.5)  +(1)(2) 

T2.2(0.2> 

(1)  (0.235)  -  0.235 

T3,2(0*2) 

(2)  (0.235)  -  0.471 

4>2(0,2) 

(0.235)  (2)  -  0.471  -  4(0,2) 

4,2(o.2) 

(0.235)  (2.5)  -  0.588  -  4(0,2) 

4.2(0,2) 

(0.471)  (2)  -  0.941  -  4(0,2) 

Pjdlo.2) 

*1,2(1)  Tl,2(0,2)  pi«>I0*1) 

(1)  (0.235)  (0.25)  -  0.353 

P1(2l0,2) 

•l,2(2)  Ti,2(0»2)  PidlO.l) 

(1)  (0.235)  (0.25)  -  0.059 

P1(0|0.2) 

1  -  (0.353  +  0.059)  -  0.588  . 

0.235 
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Calculations^ for  v  *  (1,0)  : 
Rj#1(1.0)  -  (1)  »1#1(1)  P^OlO.O) 
-  (1)  (2)  (1)  -  2 
(4)  (1)  -  4 
1 


Rj^U.O) 

*3.1(1.°) 


Tl.l(1'0> 


T2fi(1.0) 


T3#1<1,0) 


Ll,l<l*°) 

h.id'O) 

l3,i<i.o) 


Ptdli.o) 


P^Oll.O) 


(0.5)  (1) 


(0.5) (2)  +  (0.5) (4)  +  (1) (1) 

(1)  (0.125)  -  0.125 

(2)  (0.125)  -  0.250 


-  0.125 


(0.125)  (2)  -  0.25  -  ^(1,0) 
(0.125)  (4)  -  0.50  -  Ljd.O) 
(0.250)  (1)  -  0.25  -  L3(1.0) 


•i.i  Ti,i(1'0)  *i<olo.o> 

(2)  (0.125)  (1)  -  0.25 
1  -  0.25  -  0.75  . 


Calculations  for  ▼  ■  (1,1) 


Rj  jd.l)  -  (1)  n^jd)  P1(0|0,1)  +  (2)  »lfl(2)  P1(1|0,1) 
-  (1)  (2)  (0.75)  +  (2)  (1)  (0.25)  -  2 
R^jd.l)  -  (4)  (1.25)  -  5 
1 


*3 , 1  ( 1  *  1 ) 
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r V\ 


vv  V 
SV- 


'A 


«v 


v.v 


w’ 

V  v  •/ 


» .  * .  - 
>  •.■•v  1 

,  V  •, 

r/./V 

>\*  V  VI 


T  -  <°-5>  <!> 

*1.1'*—' 

(0j5)  (2)  +  (0.5)  (5) 

+(1)(1) 

T2,id.n 

■  (1)  (0.111)  -  0.111 

T3,id4) 

-  (2)  (0.111)  -  0.222 

■  (0.111)  (2)  -  0.222 

L2,l(1»1) 

>  (0.111)  (5)  -  0.555 

ll.ld'D 

>  (0.222)  (1)  -  0.222 

h.l'1'1' 

•  (1)  P1(0ll.0)  +  (2) 

■  (1) (2) (0.75)  +  (2) (1) (0.25) 

■  (2)  (1.5)  -  3 

R3.2<1*1> 

•  2 

T  M  11 

(0.5) (1) 

(0.5) (2)  +  (0.5) (3) 

♦(1)(2) 

T2#2(1»1) 

•  (1)  (0.111)  -  0.111 

Tsjdd) 

■  (2)  (0.111)  -  0.222 

Li.jd.l) 

•  (0.111)  (2)  -  0.222 

^2,2^**^ 

•  (0.111)  (3)  -  0.333 

Lj^dd) 

•  (0.222)  (2)  -  0.444 

Ljd.l)  -  0.222  +  0.222  -  0.444 
Ljd,!)  -  0.555  +  0.333  -  0.888 


-  0.111 


•l,2(2> 

-  2 


-  0.111 


L3d,l)  -  0.222  +  0.444  -  0.866 


P1(l|l,l)  -  «1(1{1)  Tltlll.l)  PjCOlO.l)  +  •1,2<1>  T1,2<1»1)  pi<0|1*0) 


»-<2) (0.111) (0.73)  +  (2) (0.111) (0.73)  -  0.333 


P1(2|lfl)  -  *1#1(2)  Tl4l(l.l)  P1(1|0,1)  ♦  a1<2(2)  Tl,2(1»1)  pidll.O) 


(1) (0.111) (0.23)  +  (1) (0.111) (0.23)  -  0.033 


P,(0|l.l)  -  1  -  (0.333  +  0.036)  -  0.611  . 


Calculation!  for  v  ■  (1.2)  : 


Rjfl(1.2)  -  (1)  s1(1(l)  P^OlO.2)  +  (2)  »lfl(2)  P1(l|0.2) 
+  (3)  *lfl(3)  P1(2|0,2) 


®2,ld*2) 

®3,i(1*2> 


Ti#i(1.2) 


T2>i(1.2) 


T3>iU.2) 


^.ld*21 

L2,l(1,2) 

L3fi(1.2) 


14.2(1»2> 


*2.2<1'2> 

*3.2(1'2) 


(1)(2)(0.588)  +  (2) (1)  (0.333)  +  (3) (1 )  (0.059)  -  2.059 


(4)  (1.588)  -  6.332 


(0.5) (1) 


(0.5) (2.059)  +  (0.5) (6.353)  +  (1)(1) 


•  0.096 


(1)  (0.096)  -  0.096 


(2)  (0.096)  -  0.192 


(0.096)  (2.059)  -  0.198 


(0.096)  (6.352)  -  0.610 


(0.192)  (1) 


0.192 


(1)  P1(0|l.l)  +  (2)  *1#2<2>  Pidll.D 

♦  (3)  *lt2<3>  P1(2|l,l) 


(1) (2) (0.611)  +  (2) (1) (0.333)  +  (3) (1) (0.056)  -  2.056 


(2) (1.888)  -  3.776 


m 


We 


s 


ft 


,,  (0.5X2) _  „A 

1»1  *  —  (0.5)(2)+(0.5)(6)+(1)(1)  “  * 

t2#1(2.°)  -  (1X0.20)  -  0.20 
t3#1(2,0)  -  (2) (0.20)  -  0.40 

Lj#1(2,0)  -  (0.20) (2)  -  0.40  -  Lj(2,0) 
Lj(1(2,0)  -  (0.20) (6)  -  1.20  -  Lj(2.0) 
L3,l(2'°)  "  <®.40)(1)  “  0.40  -  Lj(2,0) 

P1(l|2.0)  -  ij  jd)  Tlfl(2,0)  P1(0|l,0) 

-  (2) (0.20) (0.75)  -  0.300 
P1(2|2.0)  -  ^  jd)  Tlfl(2.0)  Pjdll.O) 

-  (1) (0.20) (0.25)  -  0.050 

P1(0|2.0)  •  1  -(0.300  0.050)  -  0.650  . 


Calculation*  for  v-(2,l) 

R11(2,l)  -  (1)  *lfl(D  P1(0|l,l)  +  (2)  »1#1(2)  P1(lll,l) 
♦  (3)  i14(3)  P1(2|l,l) 

-  (1)(2)(0.611)  +  (2X1X0.333)  +  (3X1X0.056) 
R^d.l)  -  (4) (1.888)  -  7.552 

*3,1(2'1>  *  1 

x  (2  1} _ <°-*><2> _ 0  172 

1>1  '  (0.5) (2.056)+(0.5) (7.552) (1) (1) 

T2,1(2«1)  "  (1)  (0.172)  -  0.172 


t3#1(2.i) 


(2)  (0.172)  -  0.345 


4,i<2»1)  -  <0.172)  (2.056)  -  0.354 
4 .1(2,1)  -  "(0.172)  (7.552)  -  1.299 
L3,l<2»1)  "  <0*345)  (1)  -  0.345 


4<2(2,1)  -  (1)  «1>2(1)  4«>l2.0)  +  (2)  «1#2(2)  P^lU.O) 

+  (3)  »1<2<3>  4<2|2,0) 

-  (1)(2)(0.650)  +  (2) (1) (0.300)  +(3) (1) (0.050)  -  2.050 
Rj  2(2,1)  -  (2)  (2.20)  -  4.40 

»3,2(2«1>  *  2 

*  (0.5)  (1) 

3'1  *  '  "  (0.5)(2.050)+(0.5)(4.40)+(1)(2)  "  °*°96 

T22(2.1)  -  (1)  (0.096)  -  0.096 
T3,2(2'1)  "  (2)  <0.096)  -  0.191 

L1.2(2*1)  "  <0.096)  (2.050)  -  0.196 
4#2(2,1)  -  (0.096)  (4.40)  -  0.421 
L3,2<2,1>  “  <°*2®2>  <2 )  -  0.383 


4(2,1)  -  0.354  +  0.196  -  0.550 
4(2,1)  -  1.299  +  0.421  -  1.720 
L3(2,l)  -  0.345  +  0.383  -  0.728 


Pidll.2) 

P1(2|2.1) 


•l,l<l)  T1#1(2,l)  P1(0|1,1)  +  «1<2(2) 
(2) (0.172) (0.333)  +  (1) (0.096) (0.650) 

•l,l(2>  Tl,l(2*1)  **i<l ll.D  +  *i,2<2> 
(1) (0.172) (0.333)  +  (1) (0.096) (0.300) 


Tl,2<2'1)  pi<0l2.0) 

-  0.335 

t1,2<2.D  P^lU.O) 

-  0.086 
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Normalising  Constants: 


G(0,1) 


G(0,2) 


G(1,0) 


G(l,l) 


G(l,2) 


G(2.0) 


4*K0.5) 

0.12S 


(4) (0.5) 
0.23S 


8.511 


(1)10.3) 

0.125 


(4) (0.5) 

0.111 


18.018 


(8.511X0.5) 

0.096 


44.328 


(4) (0.5) 

0.2 


10 


G(2,l) 


(18.018) (0.5) 
0.172 


52.378 


G(2,2) 


(44.328) (0.5) 
0.147 


150.776  . 


As  previously  stated,  the  examples  in  this  chapter  are  believed  to 
be  the  only  examples  of  MVA  in  open  literature.  In  view  of  the  length 
of  this  example,  it  should  not  be  surprising  that  it  is  believed  to  be 
the  only  multiple  ohain,  load  dependent  example-period. 
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A  nixed- network  ia  one  with  both  open  and  closed  chains.  Customers 
in  the  closed  chains  and  their  serwioe  requirement,  do  not  affect  the 
stability  of  the  network  [KEIS7S].  That  is,  a  mixed  network  is  stable, 
if  and  only  if,  p£(0pea  <  1*  for  all  i  other  than  IS  service  centers 
(Pi>Qpen  l*  utilisation  of  service  center  i  dne  to  the  open  chain 
customers).  The  open  and  closed  chains  have  a  surprisingly  simple  and 


limited  impaot  on  each  other.  In  fact*  if  the  m« 


rival  rates  of  the 


open  chains  are  constant  and  all  service  rates  are  load  independent. 


then  the  response  time  is  given  by 


s,,  [1  ♦  L,(V-1 ,] 

-  (V)  -  — L— - — 

*  pi,open 


(7.24)  - 


where  Lj(V-lj)  is  the  mean  number  of  closed  ohain  customers  when  the 
population  vector  is  V-lj  [ZAH081].  Similarly,  the  response  time  for 


open  chains  is 


*vv> 


•jj  [i  +  Ljoni 

1  “  ^i,open 


(7.25) 


The  reader  is  referred  to  the  earlier  reference  for  a  proof  of  these 
two  equations.  Note  that  it  is  only  necessary  to  compute  the  open  chain 
utilizations  in  order  to  determine  closed  chain  metrics.  Once  the 
closed  chain  metrics  have  been  determined,  those  of  the  open  chain  can 
be  calculated.  The  procedure  is  best  illustrated  by  an  example.  Figure 
7.3  depicts  a  mixed  network  with  two  service  centers.  The 
specifications  of  the  network  are  given  in  Table  7.5.  The  following 
calculations  assume  an  arrival  rate  of  0.3  and  two  customers  in  the 
closed  chain. 


v.v, 


© 


I. 

m 

•*  >  V? 


8 


wjjgjjjggj 


CHAIN  2 


Serviee 

Center 

Nnaber  of 
Servers 

Serviee 

Discipline 

Server 
Rate  nu 

Server 

Rate  |ii2 

— 

1 

FCFS 

1/2 

1/2 

2 

m 

IS 

1/3 

1/10 
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Calculations? 


*1,2  “  °*3 

•l.l  "  2  *1.1 
*2.1  "  3  *2.1 
*1,2  “  2  *1.2 
*2,2  ”  10  *2,2 


1 

1 

1 

1  . 


Obviously  the  throughput  of  the  open  chain  is  equal  to  the  arrival 
rate.  Hence, 

Tl,2  "  T2,2  “  °*3  * 

The  utilisation  at  service  center  1  due  to  the  open  ohain  is: 

Pi. 2  -  (0.3X2)  -  0.6  . 


The  performance  metrics  of  the  closed  chain  can  now  be  determined. 


Calculations  for  v  ■  1  : 


»1.1<1> 


(2) (1) 

1  ~  0.6 


Hj.ld)  -  3 


Tl,l<*> 


.  (1X1) 

-  (1) (5)  +  (1X3) 


0.125 


t2,i(1)  -  0.125 


L^jd)  -  (0.125)  (5)  -  0.625 


Lj  jd)  -  (0.125)  (3)  -  0.375  . 
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Calculation*  for  ▼  ■  2 


(2*5  Jl.625) 


*2.1<2>  “  3 


(1)  (2) 


Tl.l<2»  •  (l)'('«.12i~  *"(i>(S)  *  °-1,° 


T2,l<2)  "  0,180 


Ll.l(2)  "  <°*180>  (8*125)  -  1.461 
L2#1(2)  -  (0.180)  (3)  -  0.539 


pl.l  “  (0.180X2)  -  0.36 


Nov  that  the  aatriea  of  the  closed  chain  have  been  determined, 
those  of  the  open  chain  can  be  calculated  as  follows: 

.  12.205 

1  -  0.6 

*2.2<2)  *  *2.2  "  10 


Lj(2(2)  -  (0.3)  (12.305)  -  3.692 
Lj<2(2)  -  (0.3)  (10)  -  3  . 


The  normalizing  constant  of  a  nixed  network  can  be  expressed  as 
the  product  of  two  smaller  normalizing  constants,  one  for  the  open 
chains  and  the  other  for  the  closed  chains.  It  follows  from  the 


previous  chapter  that  the  open  chain  normalizing  constant  is: 


N 

G(open)  “  IJ-i6i  ' 


where 


[l  "  }  K.i./I4.)f' 
c 

exp  [  5  X(ei«/*lie)] 
c 


for  i  PCFS,  PS,  or  LCFS 


for  i  IS. 


(7.26) 


The  normalizing  constant  of  the  closed  chains  can  be  determined 
from  the  throughput  theorem  as  before,  or  both  normalizing  constants 
can  be  merged  into  one  by  observing  that  G(v)  is  directly  proportional 
to  G(0)  for  all  v.  Thus,  the  tvo  normalizing  constants  can  be  combined 
into  one  by  simply  defining  G(0)  as  G(0paB).  The  procedure  will  be 
illustrated  by  finding  the  normalising  constant  in  the  previous 
example. 


G(open)  "  1-0.6 


•  _ i—  e3  -  50.214 


G<°>  "  G(open) 
0(0) 


G(l)  - 


(50.214) (1) 


Tjjd)  *1'1  "  0.125 


401.711 


0<2>  -  ,  -  <-4°^“1<11  -  2.231.724 

Tjj(2)  0.125 


As  before,  it  is  simple  to  extend  the  equations  for  multiple 
chain,  load  independent  networks.  However,  the  limited  load  dependent 


uriuru 
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ease  is  considerably  sore  complicated  even  for  single  chain  networks, 
and  will  not.be  discussed  here  [KEIS83].  In  fact,  the  equations  will 
not  ewen  be  listed  for  reference  purposes  because  this  would  require 
redefining  the  notation  that  has  previously  been  used  and  would  only 
complicate  matters. 

7.4  Closed  Queue ins  Networks  without  Product  Form  Solutions 

A  major  advantage  in  the  analysis  of  closed  queueing  networks  over 
open  and  mixed  networks  is  that  if  the  network  can  be  represented  by  a 
'pure*  Markov  process  then,  theoretically,  a  solution  can  be  obtained. 
That  is,  since  the  number  of  customers  is  finite,  the  number  of  network 
states  is  finite,  and  therefore  the  prooess  can  be  completely  described 
by  a  finite  set  cf  linear  equations  which  eqnate  the  rate  of  flow  into 
a  network  state  to  the  rate  of  flow  out  of  the  same  state.  Thus,  the 
set  of  linear  equations  can  be  solved  to  obtain  steady-state 
probabilities,  and  the  other  performance  metrics  can  be  obtained  from 
these. 

The  procedure  will  be  illustrated  by  an  example.  Consider  the  two 
service  center  network  in  Figure  7.6.  It  is  assumed  that  service  center 
1  contains  an  infinite  number  of  servers  and  that  the  service  center  2 
contains  a  single  server  and  the  service  discipline  is  nonpreemptive 
priority.  It  is  also  assumed  that  all  service  times  are  exponentially 
distributed  and  that  the  number  of  customers  in  each  of  the  three 
chains  is  one.  Since  there  is  only  one  customer  per  chain,  let  the 
numbers  1,2,  and  3  represent  these  customers  and  let  the  network  state 
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Figure  7.6  Closed  Network  Without  a  Product  Fora  Solution. 

be  defined  by  P[(x)(y)]  where  (x)  and  (y)  apeeify  the  enstoaers  at 
servioe  centers  1  and  2,  respectfully.  Now  since  service  center  1 
contains  an  infinite  nnaber  of  servers,  the  order  of  cnsto'aers  at  this 
service  center  is  not  iaportant,  however  since  service  center  2  has 
only  a  single  server  and  its  service  discipline  is  nonpreeaptive 
priority,  the  specification  order  is  iaportant  and  anst  be  inelnded  in 
its  state  specification.  For  exaaple,  P[(2),(3,l)]  represents  the 
network  state  where  service  center  1  contains  the  chain  2  enstoaers  snd 
service  center  2  oontains  the  chain  3  and  chain  1  enstoaers.  Note  that 
the  chain  3  enstoaer  is  currently  being  served  st  service  center  2. 
Also  note  that  P[(0),(2,3,l)]  is  not  a  legitiaate  network  state  becanse 
when  the  chain  2  onstoaer  finishes  service,  the  chain  1  enstoaer  will 
be  served  before  the  chain  3  enstoaer.  The  steady-state  equations 


describing  the  network  are: 


Ttty  1ft 


g*t»  out 

l»2lPIM<^2.3)1  -  |i12P[(2)<1,3)]  ♦  n13P[(3) (1,2)1 
H22Pt<0) (2.1,3)]  -  nuP[(l)(2.3)]  +  h13P((3)(2.1)] 
p23P[(0)(3,l,2)]  -  nnP[(l)(3.2)]  +  h12P[(2)(3.1)] 
(|t2i+»i3>Pt<3H1.2)]  -  |t12P[(2,3)(l)]  ♦  tijjPfCO) (3,1.2)] 

(|»22+|»22)p[(2) (1,3)]  -  |i13P[(2,3)(l)]  ♦  itjjPKO) (2,1.3)] 

(|i22'*’|i23)P[(3) (2,1)]  -  u11P[(l,3)(2)J 
(|i22+|i22)p[(l)(2,3)]  -  h13P[(1,3)(2)]  ♦  ^[(O) (1,2,3)] 
(H23+Hi2,p[(2)<3.1)]  -  |i2]P[(l*2)(3)) 

(|i23+l»ii,p[(l)(3.2)1  -  |i12P((l,2)(3)] 

(H2i+Hi2+Pl3)pI<2»3)<1)l  "  Pnpt<1.2.3)(0)]  +  K22PI(3>(2»1)1 

♦  P23pC(2)(3,l)J 

(u22+tlii+Pi3)pt(l»3)<2)1  -  H12pKl,2.3)(0))  ♦  |i21Pt(3)(1.2)J 

+  P23p[(l)(3.2)J 

(I»23+I»ii+Hi2)pl(1*2)<3>l  “  Hi3pt<l.i.3)(0)]  ♦  n21P[(2)(1.3)l 

+  |»22p[(l)(2.3)] 

(p22+|ij2+|i23)pl(l»2,3)  (0)]  -  H2ipK2.3)(l))  ♦  |»22PC(1.3)(2)] 

+  H23P[(1,2)(3)]  . 

Sararal  kay  iaauaa  about  tbaaa  aquatioaa  aaad  to  ba  aaphaaixad. 
Flrat  and  aoat  aigaifieaat  ia  that  local  balaaca  doaa  aot  apply,  aad 
tharafor*  tha  proeadara  aaad  to  obtaia  tka  aolatioa  of  aatworka  with 
product  fora  doaa  not  apply  (aor  oaa  it  ba  astaadad  to  do  aolll). 


Secondly,  there  is  no  siaple  equation,  as  in  the  case  of  networks  with 
product  fora  solutions,  to  find  the  nuaber  of  feasible  networks  states. 
That  is,  there  is  no  easy  way  to  deteraine  the  nuaber  of  equations 
neoessary  to  fully  describe  the  process.  Finally,  the  equations  are 
less  syaaetrical  than  those  of  networks  with  product  fora  solutions, 
and  thus  are  considerably  aore  coaplicated  to  write.  Fortunately, 
howewer,  there  is  a  way  to  cheek  then.  If  the  equations  are  put  into 
aatriz  fora,  then  each  eoluan  aust  sua  to  zero.  The  reason  for  this  is 
that  the  set  of  equations  are  dependent.  To  obtain  an  independent  set, 
one  of  the  equations  (any  one)  is  replaced  with  conservation  of 
probability  equation  (suaaation  over  all  probabilities  equal  one). 

Returning  to  the  problea  being  considered,  once  the  steady-state 
probabilities  have  been  deterained  all  other  perforaance  aetrics  can  be 
found.  Perforaance  aetrics  by  class  can  be  obtained  fron  the  steady- 
state  probabilities  via  the  following  equations: 

-  P[<1)(2.3)]  +  P[(l) (3,2)]  +  P[(l,3) (2)] 

+  P[(l,2)(3)]  ♦  P£(1,2,3)(0)J 

Lj|2  -  P[(2)(l,3)]  +  P[(2) (3,1)1  +  P[(2,3) (1) ] 

+  P[(l,2) (3)]  +  P[(l,2,3)(0)] 

*1.3  "  *t(3)(l. 2)]  +  P[(3)(2,l>]  +  P[(2,3)(1)J 

♦  P[(l,3)(2)]  ♦  P[ (1 , 2, 3 ) (0) ] 

Lj#1  -  P[(0) (1.2,3) ]  +  P[(0) (2,1 ,3 ) ]  +  P[(0) (3,1,2) ]  +  P[(3)(l,2)] 

♦  P((2) (1,3)]  +  P((3)(2,l)]  +  P[(2)(3,l)]  ♦  P[(2,3) (1) ] 


Ljj  -  P[(0)Jl,2,3)]  +  P[(0)(2,l,3>]  +  P[(0)(3. 1,2)1  +  P[(3)(l,2)] 
♦~PI(3)(2,1)]  +  P[(l) (2,3)]  +  P[(l)(3.2)]  +  P[(l,3)(2)] 
4,3  -  P[(0)(1,2,3)J  +  P[(0) (2,1,3)]  +  P[(0)(3,l,2)]  ♦  P[(2)(l,3)] 
+  P[(l) (2,3)]  +  P[(2)(3,l)]  +  P[(l) (3,2) ]  +  P[(l,2)(3)] 

^11  ”  P]2  “  Pj3  “  0  (by  definition) 

p2>i  -  P[(0) (1,2,3 ) ]  +  P[(3) (1,2)]  +  P[(2)(l,3)]  +  P[(2,3) (1)] 

p2f2  “  PI (0) (2,1,3)]  +  P[(3) (2,1)]  +  P[(l)(2,3)]  +  Pt(1.3)(2)] 

p2,3  -  P[(0)(3,l,2)]  ♦  P[(2) (3,1)]  +  P[(l) (3,2)]  +  Pr(l,2)(3)) 

Tl,l  "  T2,l  “  p2,l  p2,l 
Tl,2  "  T2,2  “  p2,2  p2,2 
Tl,3  "  T2.3  "  p2,3  p2,3 


*1,1  "  1/pl.l 
*1,2  "  1/pl,2 
*1.3  "  1/pl,3 


*2,1  “  4, 1^4,1 
*2,2  "  4, 2^4, 2 
*2,3  "  4, 3^4, 3  ’ 


Performance  netrica  of  tho  individual  aerrice  center  are  obtained  via 
tbe  following: 

4  "  4,i  +  4,2  +  4,3 
4  "  4,i  +  4,2  +  4,3 

T1  -  T2  “  Tl.l  +  t1,2  +  Tl,3 

4  m  (4,i  Ti,i  +  4,2  4,2  +  4,3  4.3>  ^  4 
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For  exaaple  if 


“11  “  “12  “  “13  "  500 
“21  “  “22  “  “23  “  i'000 


then  the  steady-state  probabilities  ere: 


P[(0)(l,2,3)] 

■  0.05203 

P[(0) (2,1,3)] 

•  0.05468 

P[(0) (3,1,2)] 

-  0.04119 

P[(3) (1,2)] 

-  0.05754 

Pf(2)(l,3» 

-  0.06653 

P[(3) (2,1)] 

-  0.03340 

P[(l) (2,3)] 

-  0.07536 

P[(2)(3,l)] 

-  0.04119 

P[(l)(3,2)] 

-  0.04119 

P[(2,3)(l)] 

-  0.09023 

P[(l,3)(2>] 

-  0.10199 

P[(l,2) (3)] 

-  0.12357 

P[(l,2,3)(0)] 

-  0.21053 

and  the  perforaanee  aetrics  are 


Lj  2  -  0.53204 

W.2  “  0.46796 

Lj  3  -  0.49428 

Lj#3  -  0.50572 

Lj  -  1.5789 5 

Lj  -  1.42105 

T1  1  -  276.32 

T2,l  “  27<*32 

Tl,2  " 

t2,2  " 

Tl,3  "  247*14 

*2.3  -  247.14 

T2  -  789.48 

T2  -  789.48 

*1.1  “  2E~3 

Ijj-  1.6190E-3 

*1.2  *  2E‘3 

*22  -  1.7591R-3 

*1,3  -  2B"3 

Rjj  -  2.0463E-3 

Rj  «  2.0E-3 

Rj  -  1 . 8000E-3 

pl.l  *  0 

p2,l  "  0.276*2 

Pl,2  -  0 

P2  2  ■  0.26602 

Pl,3  "  0 

p2<3  "  0.24714 

Pi  ■  o 

p2  ■  0.78948  . 

Soae  additional  coaaenti  art  appropriate.  First,  the  procedure 
cannot  ba  applied  to  all  closed  queueing  networks.  The  network  aust  be 
be  representable  by  a  'pure'  Markov  prooess.  That  is.  all  of  the 
servioe  tiae  distributions  aust  be  exponential  or  aust  be  able  to  be 
represented  by  exponential  stages.  Note  that  if  the  service  tiae 
distribution  oontains  a  discontinuity,  then  an  infinite  nuaber  of 


exponential  stages  is  required.  For  example,  if  service  tine  is 
deterministic,  then  it  cannot  be  represented  by  the  method  of  stages. 
There  is  also  a  practical  limit  to  the  number  of  equations  that  can  be 
solved.  Xeoall  that  the  number  of  netvorh  states  increases  rapidly  with 
the  number  of  customers,  ohains  and  service  centers.  It  also  increases 
rapidly  if  the  service  time  must  be  represented  by  the  method  of 
stages.  It  is  not  unusual  for  even  a  small  two  service  center  network 
to  have  well  over  1,000  states.  Finally,  aa  previously  stated,  an  open 
network  that  limits  the  customer  population  to  some  finite  number  is 
equivalent  to  a  closed  network.  Thus,  in  theory  the  procedure  can  be 
applied  to  these  networks,  however,  more  often  than  not  the  number  of 
feasible  network  states  prohibits  it. 
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CONCLUSIONS 


8.1  The  Deceptive  Servlet  Center 

Figure  8.1  depict*  *  eiaple  service  center.  Customers  arrive  at 
the  service  center,  wait  in  line  for  one  of  the  two  servers  to  become 
free,  receive  service,  and  depart.  One  vonld  sorely  think  that  for  snch 
a  simple  system  equations  for  the  mean  performance  metrics  coold  be 
derived.  However,  this  is  an  open  research  problem,  and  has  only  been 
solved  for  two  special  eases  [LAVE83].  These  cases  were  discussed  in 
this  text  and  are  (1)  the  M/M/a  system,  and  (2)  the  M/G/a  system  with 
LCFSPR  service  discipline. 


SERVICE  CENTER 

Figure  8.1  A  'Simple'  Service  Center. 

Obviously,  this  'simple'  problem  has  been  around  for  quite  some 


time,  and  what  makes  it  so  deceptiv*  is  its  simple  representation.  This 
problem  symbolizes  the  paradoxical  nature  of  the  discipline. 


8.2  Ponndation 

Moat  of  the  aaterial  covered  is  chapters  1  through  4  contains 
aaterial  noraally  taught  in  a  graduate  level  conrae(s).  The  aaterial 
was  presented  here  as  foundation  to  support  the  throat  of  this  text: 
'Markovian  Network  Theory'.  Clearly,  before  one  can  analyze  a  network 
of  service  centers,  one  anst  first  learn  how  to  analyze  single  service 
centers. 

8.3  Contributions 

Chapter  5  contains  the  only  known  exaaple  of  looal  balance  being 
nsed  to  solve  a  network  of  two  or  aore  service  oenters.  In  addition,  it 
was  illustrated  by  exaaplea  that  if  the  arrival  rate  to  a  network 
varied  according  to  the  nnaber  of  custoaers  in  the  systea  (up  to  soae 
finite  nuabar  after  which  arrival  ceased),  then  the  network  could  be 
napped  into  an  equivalent  closed  network  (also  applies  to  networks  in 
Chapter  6).  This  was  stated  by  other  authors,  but  again,  these  are 
believed  to  be  the  only  known  exaaples  in  the  literature.  It  was  also 
stated  by  others  that  the  serviee  rate  of  a  service  center  could  be  a 
function  of  both  the  nnaber  of  custoaers  in  the  service  center  and  of 
the  nnaber  of  custoaers  in  a  subset  of  service  centers,  however,  no 
references  were  given.  This  was  proved  in  Chapter  5. 

Credit  for  the  pioneering  work  in  Chapter  6  belongs  to  the  authors 
Baskett,  Chandy,  Muntz,  and  Palacios,  however,  in  order  to  clear  up  the 
aabiguities  in  their  paper  it  was  necessary  to  rederive  nost  of  their 
equations  and  to  derive  soae  that  are  not  present.  The  reasons  for  this 
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vex*  :  (1)  Then  representing  nonezponentisl  service  tine  by  the  nethod 
of  exponential  stages  there  is  a  finite  probability  that  a  customer 
will  experience  a  xero  length  service  tine.  They  acknowledged  this  in 
their  paper,  bnt  they  did  not  include  its  existence  in  their 
derivation.  Such  an  existence  was  illustrated  in  the  exaaple  given  in 
section  6.2  where  this  probability  was  1/4.  (2)  Even  for  the  less 
general  case  that  they  did  oonsider,  their  equations  for  f^x^)  which 
contain  teras  that  account  for  the  stages,  are  erroneous  (indices  and 
subscript  errors). 

As  a  result  of  considering  the  aore  general  case,  a  general 
equation  for  the  aean  service  tiae,  in  teras  of  the  aean  service  tiae 
at  each  stage  was  derived.  This  equation  is  necessary  in  order  to  - 
derive  the  equations  for  the  aggregate  network  states,  but  such  an 
equation  was  not  given  in  the  original  paper.  A  third  aggregate  state, 
which  coabines  all  classes  in  a  chain  into  one  'equivalent  class',  was 
not  included  in  their  paper,  but  followed  easily  froa  the  rederivation 
(this  state  was  alluded  to  by  other  authors  and  probably  exists 
soaewhere  in  the  literature,  but  was  not  found).  This  state 
significantly  reduces  the  aaount  of  work  that  is  required  to  deteraine 
the  noraalising  oonstant. 

The  process  of  rederiving  the  equations  for  the  f^XjVs  resulted 
in  a  auch  clearer  understanding  of  types  PS  and  IS  service  centers. 
There  is  never  a  queue  or  waiting  line  at  these  types  of  service 
centers.  In  addition,  all  custoaers  are  receiving  service  siaul- 
taneously.  Thus,  for  type  IS  serviee  centers  each  stage  behaves  as  sn 
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independent  service  center.  The  only  difference  for  type  PS  service 
centers  is  t.hat  the  service  rate  st  each  stage  depends  upon  the  total 
nuaber  of  ens toners.  It  was  proved  in  Chapter  5  that  the  service  rate 
of  a  subset  of  service  centers  conld  depend  on  the  nnaiber  of  customers 
in  the  subset.  Thus,  in  both  cases  the  stages  behave  as  service  centers 
with  an  exponential  service  tine. 

It  follows  froa  this  that  the  proofs  given  in  Chapter  5  are 
sufficient  for  networks  with  types  FCFS,  IS,  and  PS  service  centers 
(classes  and  nonexponential  service  tines  are  allowed  at  IS  and  PS 
service  centers,  but  not  at  FCFS  service  centers).  The  theorea  given  in 
the  paper  applies  to  these  cases  and  to  LCFSPK  service  centers  with 
nonexponential  service  tiaes  and  classes.  In  addition  classes  are 
allowed  at  FCFS  service  centers  under  the  constraint  that  they  have  the 
saae  exponential  service  tiae  distribution  function.  It  is  true,  as  the 
authors  state,  that  if  the  local  balance  equations  are  satisfied 
(apply),  then  the  theorea  holds.  However,  the  difficulty  is  in  proving 
that  the  local  balance  applies  for  any  network  coaposed  of  these  types 
of  service  centers.  It  can  be  shown  to  apply  for  specific  networks,  but 
this  was  not  done  in  their  paper.  There  are  several  exaaples  in  this 
text  shoving  that  looal  balance  applies. 

There  are  also  several  exaaples  shoving  that  if  the  network 
contains  service  centers  other  than  these  types  then  local  balance  is 
not  applicable.  For  exaaple,  if  the  service  discipline  is  FCFS  snd 
different  nean  service  tiaes  are  allowed  for  different  classes,  then 
the  local  balance  equations  sre  inconsistent.  Another  counter  exaaple 


it  when  the  service  discipline  is  nonpreenptive  priority,  in  this  case 
not  all  the~global  balance  equations  can  be  subdivided  into  local 
balance  equations,  hence  local  balance  does  not  apply. 

Chapter  7  contains  nnsierous  examples  illustrating  how  to  apply  the 
Mean  Value  Analysis  (MVA)  algorithm  to  closed  networks.  Examples  for 
the  following  types  of  networks  were  given:  single  chain,  load 
independent;  single  chain,  load  dependent;  multiple  chain,  load 
independent;  multiple  chain,  load  dependent;  and  single  closed  chain, 
load  independent  mixed  network.  It  was  stated  in  this  chapter  that 
these  were  the  only  known  examples  of  the  MVA  algorithm,  however,  some 
have  been  found  for  cyclic  networka  (cyclic  networks  are  a  special  case 
of  single  chain,  load  independent  networks). 

In  addition  the  concept  of  using  the  throughput  theorem  in 
conjunction  with  MVA  to  obtain  the  normalizing  constant  is  not 
presented  elsewhere.  At  present,  there  is  no  algorithm  that  can  always 
prevent  overflow  when  trying  to  determine  the  normalizing  constant 
[LAVE83].  In  the  event  of  overflow  these  algorithms  fail.  This  is 
irrelevant  when  using  MVA  since  it  does  not  depend  on  the  determination 
of  this  constant  in  order  to  determine  the  mean  performance  metrics. 
The  advantage  of  using  the  throughput  theorem  with  MVA  is  that  when 
overflow  is  not  a  problem  the  normalizing  constant  can  be  obtained  and 
even  if  overflow  does  occur,  the  mean  performance  metrics  can  still  be 
obtained.  The  disadvantage  of  this  technique  is  that  it  requires  more 
memory,  however,  this  is  often  not  a  problem. 

Some  of  the  contributions  claimed  may  quite  possibly  appear 


soaewhere  ia  the  literature  (ia  particular,  the  aggregate  atate  that 


deals  with  aha i as,  aad  the  stage  equatioa  for  the  aeaa  service  tiae). 


but  the  fact  that  they  were  aot  found  aad  had  to  be  rederived  iadicates 


that  the  aaterial  badly  aeeded  unifying.  This  vas  accoaplished  ia  this 


work,  aad  because  of  the  subject  Batter  aad  voluae  of  the  aaterial,  it 


is  believed  to  be  a  aajor  contribution. 


8.4  A  Characterisation  of  Networks  with  Product  Fora  Solutions 


For  a  network  of  service  centers  to  have  a  product  fora  solution 


each  service  center  ia  the  network  aust  aeet  one  of  the  following  sets 


of  conditions  [CHAN77]  [CHAN83]: 


(1)  If  the  service  discipline  is  FCFS,  then  the  aean  service  tiae  of 


all  custoaer  classes  aust  be  the  saae,  and  the  distribution  aust  be 


negative  exponential  (each  custoaer  class  aay  have  its  own  set  of 


routing  probabilities). 


(2)  If  the  service  discipline  is  such  that  every  custoaers  starts  to 


receive  soae  servioe  iaaediately  upon  arriving,  then  each  custoaer 


class  aay  have  its  own  general  service  tiae  distribution  (the  density 


function  aust  have  a  rational  Laplace  transfora)  and  routing 


probabilities.  Note,  service  center  types  LCFSPR,  PS  and  IS  aeet  the 


condition  that  each  custoaers  starts  to  receive  soae  service 


iaaediately  upon  arrival. 


In  addition,  if  the  network  is  open,  then  all  arrival  processes 


froa  outside  the  network  aust  be  Poisson,  and  no  queue  can  saturate 


(utilization  >  1). 
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If  a  network  aeets  theae  conditions  then  the  steady-state 


probability  that  the  network  is  in  state  (z^,X2»...»z^)  is  given  by: 

Pl<xl)  p2(x2)  •“ 

P(z1,z2,....zN) - - -  * 

where  N  equals  the  number  of  service  centers,  z ^  represents  the 
conditions  prevailing  at  service  center  i,  Pi(zi)  is  a  factor 
corresponding  to  probability  that  service  center  i  is  in  state  x^,  and 
6  is  a  noraalizing  constant  chosen  to  Bake  the  probabilities  sub  to 
one. 

The  faotor  P^x^)  contains  only  paraaeters  that  pertain  to  service 
center  i.  It  is  the  saae  factor  that  results  froa  assuming  that  the 
arrival  prooess  is  Poisson  and  analyzing  the  service  center  in 
isolation.  If  the  network  is  open  and  the  arrival  process  does  not 
depend  on  the  nnaber  of  cnstoaers,  then  the  aean  arrival  rate  can  be 
uniquely  deterained.  However,  if  the  network  is  closed,  then  the 
arrival  rate  (saae  as  relative  throughput)  can  only  be  determined 
relative  to  the  arrival  rates  at  the  other  service  centers.  In  this 
case  a  positive  value  is  assigned  to  the  arrival  rate  at  one  of  the 
service  centers.  The  others  can  then  be  deterained  (the  noraalizing 
constant  will  coapensate  for  this).  Vhat  is  aaazing  about  this  is  that, 
in  general,  the  arrival  process  at  the  individual  service  centers  sre 
not  Poissonl  What  is  even  aore  aaazing  is  that  if  one  knew  exactly  vhat 
the  arrival  process  was  he  could  not  obtain  an  exact  solution,  since  st 
present  only  partial  results  have  been  obtained  for  the  G/M/l  system. 

It  is  important  to  emphasize  that  all  of  the  solutions  thus  far 


have  bean  obtained  by  guessing  at  tbe  ansver  or  by  local  balance  (a 
fora  of  gneaarjng).  In  other  words,  the  solntions  can  be  proved  by 
substituting  the  guessed  at  results  into  the  global  balance  equations 
and  determining  if  they  are  satisfied.  However,  at  present,  there  is  no 
way  to  derive  the  results. 

8.5  Approximate  Solution  to  Queueing  Networks 

If  a  network  does  not  have  a  product  fora  solution  then  the 
distribution  of  customers  at  a  service  center  is  a  function  not  only  of 
the  service  center  in  question,  but  also  of  other  parameters  in  the 
network.  This  is  an  extremely  difficult  problem.  One  approach  is  to 
make  an  assumption  that  allows  an  answer  to  be  obtained  (usually  the 
assumption  is  true  for  networks  with  product  form  solutions  and 
hopefully  an  approximation  for  other  networks),  then  to  validate  the 
assumption  by  shoving  that  the  answer  is  close  to  the  solution  to  the 
problem  that  was  (presumably)  unsolvable.  In  other  words  an  answer  has 
to  be  obtained  by  some  other  means  than  queueing  theory  such  as 
simulation.  If  the  assumption  is  tested  for  similar  networks  and  it 
also  holds  (produces  small  errors),  then  one  can  use  it  in  the  future 
on  similar  networks  without  testing  it.  Such  solutions  are  heuristic 
and  cannot  be  formally  defended.  At  present  all  of  the  techniques  for 
obtaining  approximate  solutions  fall  into  this  category  [SAUE81], 
Hence,  for  this  reason  they  were  not  covered  in  this  text.  There  are 
quite  a  few  heuristic  approaches  that  can  be  used  on  closed  networks, 
but  few  have  been  extended  or  shown  to  hold  for  open  networks  (some 


263 


have  been  shown  not  to  b«  applicable  [LAVE83]).  On*  of  tbs  rsasons  for 
this  Is  thO  olossd  networks  are  in  a  sense  self  regulating  and 
therefore,  sore  predictable.  Even  for  closed  networks  without  product- 
fora  solutions  bounds  can  often  be  obtained,  although  they  are  somewhat 
loose.  It  should  be  obvious  that  the  development  of  heuristic 
techniques  is  a  trial  and  error  procedure.  In  addition,  one  can  spend 
considerably  more  time  trying  to  validate  them  than  developing  them. 

8.6  Review  of  Latest  Textbooks 

Although  there  is  still  not  a  comprehensive  text  devoted  to  the 
area  of  queueing  network  theory,  three  texts  that  uae  the  theory  were 
published  during  the  course  of  this  research. 

1.  A  Computer  and  Communications  Network  Performance  Analysis,  by 
B.W.  Stuck  and  E.  Arthurs,  Printiee-Hall,  1985. 

2.  Performance  Analysis  of  Local  Computer  Networks,  by  J.L. 
Hammond  and  J.P.  O'Reilly,  Addison-Wesley,  1986. 

3.  jklRggBRBi&Rtigai  Network  :  Protocols.  Modeling  and  Analysis. 
M.  Schwartz,  Add isson-We slay,  1987. 

8.6.1  Textbook  bv  Stuck  and  Arthurs 

The  text  by  Stuck  and  Arthurs  is  the  extreme  opposite  in  almost 
every  way  of  the  material  covered  here.  As  they  indicate  in  their 
preface,  virtually  no  time  at  all  is  spent  deriving  results.  Their 
philosophy  is  suggested  in  the  prefsce  as:  'The  crux  of  engineering, 
in  our  opinion,  is  manipulating  numbers  in  a  great  variety  of  ways  to 
gain  qualitative  insight  into  design  issues  via  quantitative  methods'. 
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A  second  motivation  it  given  in  terns  of  the  nind-set  of  their  Bell 
Laboratory  g'rqjluate  engineers:  'Many  of  then  ere  siaply  not  interested 
in  derivations'.  Therefore,  the  widely  used  approach  for  deriving 
fnndanental  results  was  purposely  ignored  in  this  text,  whereas  in 
contrast,  it  is  the  derivation  of  fundamental  relationships  that 
constitutes  the  purpose  and  content  of  this  dissertation. 

The  book  prinarily  foeuses  on  closed  networks  and  obtaining  bounds 
for  such  networks.  Jackson-type  networks  are  introduced  in  their 
Chapter  6.  The  following  two  chapters  are  concerned  with  applications 
of  Jackson-type  networks.  However,  the  enphasis  is  heavily  on 
obtaining  bounds  for  these  types  of  networks.  Several  hours  were  spent 
reviewing  these  two  chapters,  and  although  sone  Jackson-type  equations 
appear,  it  is  doubtful  that  there  is  a  single  problen  worked  out  using 
then.  The  material  on  Jackson-type  networks  is  perhaps  the- worst  in  the 
text.  There  is  sone  material  on  open  networks,  however  it  is  presented 
in  such  a  way  that  it  is  extremely  difficult  to  extricate  it  from  that 
on  closed  networks.  In  order  to  get  around  having  to  explain  how  to 
determine  the  normalizing  constant,  a  computer  program  is  simply  given. 
The  approach  use  in  these  chapters  seems  to  be  to  cover  as  many  cases 
as  possible  and  provide  equations  for  these,  rather  than  to  stress  the 
fundamentals  and  provide  a  few  general  examples. 

Single  service  centers  are  discussed,  but  only  after  networks  of 
service  centers.  Again  quoting  from  the  preface,  the  material  in  these 
chapters  (the  last  two)  is  the  most  mathematicslly  sophisticated,  and 
requires  the  greatest  intellectual  maturity.  It  should  also  be  noted 
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that  the  only  systeas  discussed  in  then  are  of  the  type  M/G/l.  The 
M/M/1  and  M/M/a  systeas  are  not  discussed  here  or  anywhere  else  in  the 
book. 


o.d.2  Textbook  bv  Saaaond  and  G'Es ilir 

Haaaond  and  O'Reilly  devote  very  little  effort  to  deriving  the 
basic  queueing  theory  equations.  For  exaaple,  the  aean  perforaance 
aetrics  of  the  M/6/1  aodel  are  developed  firat.  The  equations  for  the 
M/M/1  are  developed  froa  these.  In  the  chapter  on  queueing  theory  a 
total  of  three  pages  are  spent  on  queueing  networks.  The  eaphasis  is 
on  explaining  the  different  types  of  queueing  networks:  open,  closed 
and  aixed.  The  discussion  on  aixed  network  is  aabignons  since  the 
figure  referenced  is  an  open  network  with  feedback.  Also,  depicted  in 
this  section  is  an  open  network  with  three  service  centers  in  tandea 
(the  output  of  the  first  feeds  direotly  to  the  input  of  the  second, 
etc.)  and  it  is  pointed  out  that:  'this  type  of  queueina  network  is  of 
the  tvne  aost  often  used  for  aodel ina  aultiaocess  networks,  and  thus 
attention  is  restricted  to  this  type*.  Burke's  Theorea  is  then  quoted 
and  it  is  stated  that  this  type  of  network  can  be  broken  down  into  a 
collection  of  M/M/1  and  M/6/1  submodels.  However,  it  should  be  noted 
that  this  stateaent  cannot  be  foraally  defended. 

Burke's  Theorea  states  that  the  output  process  of  a  M/M/a  system 
is  Poisson  and  independent  of  all  other  processes  in  the  system. 
However,  Burke  also  proved  that  it  is  the  only  such  FCFS  system  with 
this  property  [KLEI75].  The  procedure  is  used  in  the  chapter  on  ring 


networks*  and  it  is  believed  that  their  justification  is  contained  in 
the  following _two  sentences:  'The  interarrival  tines  and  the  service 
tines  are  independent*  thns  the  chain  of  station  elenents  in  Pig  8.22 
can  be  broken  np  into  independent  snbnodels  for  each  station.  This 
sssunption*  which  results  in  a  very  tractable  nodel*  has  been  shown  by 
conparison  to  sinulation  results  to  give  reasonably  acourate*  although 
sonewhat  pessinistic  results'.  While  the  statenent  that  the 
interarrival  tines  are  independent  is  true*  the  arrival  process  is  the 
sun  of  two  processes,  one  of  which  is  Poisson  and  the  other  non- 
Poisson.  Thus,  it  is  believed  that  the  seoond  sentence  is  actually  the 
justification  for  the  first. 

The  following  is  quoted  fron  the  cover  of  the  book  'the 
perfornance  nodels  disousaed  are  developed  in  as  elenentary  a  manner  as 
possible,  often  using  a  heuristic  rather  than  a  rigorous  approach'. 
There  is  nothing  wrong  with  the  approach,  and  it  is  one  of  the 
strengths  of  the  book,  yet,  it  is  necessary  to  know  when  assumptions 
suoh  as  these  can  be  made.  If  it  is  not  clearly  stated  as  an 
assumption,  and  the  conditions  under  which  it  is  applicable  are  not 
pointed  out,  then  one  is  likely  to  misuse  it. 

8.8.3  Tertbook  bv  Schwarts 

The  book  by  schwartz  relates  more  than  any  of  the  others  to  the 
work  contained  in  this  dissertation.  He  devotes  an  entire  chapter  to 
developing  the  fundamental  queueing  theory  equations.  However, 
compared  to  Chapter  2,3  and  4  of  this  work  the  book  is  somewhat  brief. 


For  example,  the  strong  eonneotion  between  Merkow  prooesses  end 
queueing  theory  is  not  explored.  The  M/M/1  end  M/M/2  ere  enelyzed  es 
birth  end  death  prooesses.  however  there  is  no  mention  of  feet  that 
this  is  a  special  oese  of  a  Markovian  prooess.  He  brings  out  the  fact 
that  in  the  M/0/1  systea  the  service  tiae  is  not  aeaoryless.  and  one 
can  no  longer  set  up  a  siaple  balance  equation  for  states  of  the 
systea.  He  then  proceeds  to  look  at  the  systea  at  only  departure 
instants  without  an  explanation  as  to  why  this  is  being  done  (i.e.. 
because  an  eabedded  Markov  process  exists  at  these  points).  He  then 
uses  the  saae  trick  (his  terainology).  as  in  Haaaond  and  O'Reilly,  to 
arrive  at  the  aean  perforaance  equations  without  going  through  the 
detailed  analysis  that  was  given  in  Chapter  4  of  this  work. 

There  is  even  a  section  on  queueing  network  theory  in  Chapter  5  of 
the  book.  Again  it  is  brief,  but  probably  adequate  for  application 
purposes.  For  exaaple.  he  does  state  that  a  queueing  network  is  a 
aul t idiaenional  birth  and  death  process  and  writes  out  the  general 
equations  for  an  open  queueing  network  with  exponential  service  tines. 
He  does  not  develop  the  equations  for  closed  networks,  but  simply 
states  them.  He  does  discuss  techniques  for  determining  the  normalizing 
constant,  but  only  considers  single  chain  networks  with  load 
independent  servioe  rates.  From  an  applications  point  of  view  the 
material  in  this  section  of  the  book  is  close  to  the  material  in 
Chapters  5  (this  work).  However,  there  are  salient  differences.  For 
example  Burke's  Theorem,  local  balance,  and  the  fact  the  arrival 


proci 


not  Poiaaon,  are  not  even  mentioned.  In  addition  there 


m 


fi  r»  r»  r».n  I  *  i 


are  •  few  partial  exaaples,  bat  none  worked  froa  beginning  to  end  ae 
those  in  Chapter  S  of  this  work. 

It  ie  not  enrprieing  that  service  disciplines  snch  as  PS  and 
LCFSPB  are  not  oovered  in  this  text  since  it  is  on  coaannicatlons 
systeas.  However,  it  is  soaewhat  surprising  that  classes  and  type  IS 
service  centers  are  not  covered  in  the  book.  As  deaonstrated  by  the 
exaaple  in  Chapter  6  of  this  work,  classes  are  soaetiaes  necessary  in 
coaannicatlons  systea  in  order  to  describe  the  routing  of  aessages.  In 
addition  IS  service  centers  can  be  used  to  account  for  propagation  and 
other  delays  that  are  encountered  in  networks  that  stretoh  across  the 
nation.  In  contrast  to  the  text  by  Haaaond  and  O'Reilly,  this  author 
is  quite  rigorous  when  it  coaes  to  specifying  that  a  technique  is  an 
approxiaation  or  that  an  assuaption  is  aade  to  get  answer.  In  aany 
cases  he  does  specify  the  range  over  which  the  approxiaation  or 
assuaption  is  valid. 

8.^.4  Pinal  Reaarks 

One  of  the  coaaon  failings  in  each  of  the  three  books  reviewed  is 
that  they  all  delegate  very  little  space  to  the  derivation  of  basic 
queueing  theory  equations.  The  naterial  is  conceptually  ooaplex  and  can 
be  aatheaatically  intiaidating  to  such  an  extent  that  authors  feel  that 
it  is  neoessary  to  gloss  over  it  so  as  to  have  rooa  to  present  their 
applications  techniques.  Understandably,  since  the  texts  are 
applications  oriented,  one  would  expect  then  to  be  heevily  weighted  in 


this  direction.  It  should  be  brought  out  that  this  gap  needs  to  be 


bridged  with  references  that  ere  in  themselves  understandable. 

It  wee-one  of  the  purpose  of  the  dissertation  to  enhanoe  that 
understandability  and  thereby  narrow  that  gap.  It  has  done  so  by  going 
to  the  sonree  material  developed  by  pioneers  in  the  discipline.  Where 
the  explanations  have  been  brief  and  obscure,  they  have  been  expanded 
and  clarified.  Where  illustrative  examples  where  not  given,  they  were 
worked  out.  Where  proofs  could  not  be  found,  they  were  developed. 


APPENDIX  A 


-  SUPPLEMENTARY  LOCAL  BALANCE  PROBLEMS 

A.l  FCFS  with  Two  Classes 

Figure  A.1  deplete  *  queueing  network  coaposed  of  one  service 
center  with  two  cnstoaer  classes.  It  is  assuaed  the  eustoaers  arrive 
froa  Poisson  sources.  The  aean  arrival  rates  of  class  1  and  class  2 
eustoaers  is  and  X2  respectively.  It  is  also  assuaed  that  the 
service  tiae  distributions  of  both  classes  are  exponentially 
distributed.  However,  the  aean  aervioe  rates  aay  or  aay  not  be  the 
saae.  The  network  will  be  analysed  for  both  FCFS  and  LCFSPR  service 
disciplines. 


CLASS  1 


Figure  A.l  Service  Center  with  Two  Customer  Classes. 

The  following  analysis  assuaes  that  the  service  discipline  is  FCFS 
and  that  the  rates  m2  *°d  m2  different.  The  global  balance 
equations  for  states  with  two  or  fewer  eustoaers  are: 


(X^JPCO)  -  MiPd)  +  M2Pd> 

(Xj+Xj+MjJPd)  -  MiPd.l)  +  M2P(2.1)  +  X1P(0) 


(X^Xj+p^Pd)  -  HiPU.2)  +  I*2p<2,2)  +  X2P(0) 

(Xj+Xj+iijiPii.i)  -  ^Pd.1.1)  +  u2p(2.i.d  ♦  XjPd) 

(Xj+Xj+HjJPd,!)  -  iijPd.1.2)  +  h2P(2,1.2)  +  X2P(1) 

(X1+X2+|»2)P(2.1)  -  iijPd.2.1)  +  n2P(2,2.1)  +  XjPU) 

(X1+X2+|i2)P(2,2)  -  jijPd.2.2)  +  h2P(2,2»2)  +  XjP(2)  . 

Observe  that  there  ere  only  seven  equations  and  15  unknowns.  Also,  note 
that  no  natter  how  aany  equations  are  written  there  will  always  be  aore 
unknowns  than  equations. 

Now  assuae  that  loeal  balanoe  holds.  That  is,  the  rate  of  flow  out 
of  a  state  due  to  custoaer  of  class  c  departing  is  equal  to  the  rate  of 
flow  into  the  saae  state  due  to  the  arrival  of  a  olass  c  custoaer.  The 
looal  balance  equations  that  correspond  (the  sua  of  the  local  balance 
equations  are  the  global  balance  equations)  to  the  seven  global 
equations  are  : 

X2P(0)  -  nxP(l) 

X2P(0)  -  |»2P<2) 

XxPd)  -  iijPd.1) 

X2P(1)  -  p2P(2,l) 

njPd)  -  x2p(o) 

XjPd)  -  iijPd.2) 

X2P(2)  -  h2P(2,2) 

H2P<2)  -  X2P(0) 


XjPd.l)  -  njPU.l.l) 
X2P(1,1)  -  |i2P(2.1»1) 

~  njPd.n  -  XjPCi) 

XjPd.2)  -  jijPd.1.2) 
X2P(1,2>  -  h2P(2.1.2) 
^Pd.2)  -  X2P(1) 

XjP(2,l)  -  HjPd.2,1) 
X2P(2,1)  -  |»2P<2,2,1) 
H2P(2,1)  -  XjP(2) 

X1P(2,2)  -  tijPd.2,2) 
X2P(2,2)  -  |i2P(2.2,2) 
H2P(2,2)  «  X2P(2)  . 

The  following  is  a  subset  of  the  looal  balance  equations 

HjPd)  -  XjPtO) 

H2P<2)  -  X2P(0) 

HjPd.l)  -  XjPd) 

^Pd.2)  -  XXP(2) 

11^1,2)  -  X2P(1) 

H2P(2,1 )  -  X2P(1) 

H2P(2,1)  -  XjP(2) 

M2P<2,2)  -  X2P(2)  . 


Solving  these  equations  in  terns  of  P(0)  results  in  : 


~  P(l.l)  -  (Xx)2  d/^)2  P(0) 

P(l»2)  -  (Xj)  (Xj)  (1/iij)  d/pj>  P(0) 

P(l. 2)  -  (xx)  (x2)  (l/iij)2  P(0) 

P(2,l)  -  (X2)  (Xj)  (1/nj)  (l/|i2)  P(0) 

P(2,l)  -  (Xx)  (X2)  (l/n2)2  P(0) 

P(2.2)  -  (X2)2  (l/ji2)2  P(0)  . 

Ob *o rye  that  there  ere  two  equations  for  Pd, 2)  end  P(2,l).  Also 
notice  that  they  ere  inconsistent.  The  oonclnsion  is  that  local  balance 
does  not  apply  if  the  service  rates  are  different  for  the  two  classes. 
However,  if  pj-pj-ii,  then  local  balance  does  hold,  and  the  form  of  the 
solution  is  : 

PUj.Xj . xk)  -  [X2kl  X2k2]  [(l/|i)kl+k2l  P(0) 

where  and  k2  equals  the  nuaber  of  class  1  and  class  2  customers 
respectively. 

A.2  LCFSPR  with  Two  Classes 

If  the  service  discipline  of  the  network  in  Figure  A.1  is  changed 
to  LCFSPR,  then  the  global  balance  equations  are: 

(X1+X2)P(0)  -  PjPd)  +  p2P<2) 

(Xj+Xj+iijlPd)  -  jijPd.l)  +  h2P<2,1)  +  XjPtO) 

(X1+X2+p2)P(2)  -  jijPd.2)  +  u2P(2,2)  +  X2P(0) 

(Xj+Xj+jijjPd.i)  -  pjPd.i.i)  +  h2p(2,i,d  ♦  XjPd) 


(X1+X2+h1)PU,2)  -  HjPd.1.2)  +  |i2P(2,l,2)  +  XjPd) 
(Xj+Xj+iijJPUJ)  -  |^P(1. 2.1)  +  ji2P(2.2.1)  +  X2P(1) 
(X1+X2+|i2)P(2,2)  -  iijPd.2.2)  +  ji2P(2,2,2)  +  XjP(2) 

The  corresponding  local  balance  equations  are: 

XjPeo)  -  i^Pd) 

X2P(0)  -  m2P(2) 

x2Pd)  -  njPd.i) 

X2P(1)  -  h2P(2,1) 
i^Pd)  -  XjPto) 

XXP(2)  -  |^p(l, 2) 

X2P(2)  -  |12P(2,2) 

H2P(2)  -  X2P(0) 

XjPd.i)  -  iijPdd.n 
X2P(1,1)  -  ii2P(2,1.1) 
iijPd.i)  -  x2Pd) 

XjPd.2)  -  (ijPd.1.2) 
X2P(1,2)  -  |i2P(2»1.2) 
PjPd.2)  -  XXP(2) 

X1P(2,1)  -  jijPd.2.1) 
X2P(2,1)  -  |i2P(2,2,l) 
P2P(2,1)  -  X2P(1) 


X2P< 2.2 )  -  HP(1,2.2) 
X2P<2.2)  -  h2P(2»2,2) 
|i2P(2,2)  -  X2P<2)  . 


I 


| 


The  following  is  s  subset  of  the  loosl  bslsnee  equations  : 

lijPd)  -  X^tO) 
ji2P(2)  -  X2P(0) 
jijPd.l)  -  XjP(l) 

»s1P(l,2)  -  XXP(2) 
ti2P(2.1>  -  X2P(1) 

H2P(2,2)  -  X2P(2)  . 

There  are  six  equations  and  seven  unknowns.  Solving  these  in  terns  of 
P(0)  results  in  : 


P(l) 

as 

(x2> 

d/14)  p(o) 

P(2) 

3K 

(x2) 

d/p2)  p«» 

p<i. 

1) 

-  (X2 

)2  (l/pj)2  P(0) 

p(i. 

2) 

-  <X1 

)  (x2>  (l/gj)  d/n2) 

P(0) 

P(2, 

1) 

-  <X1 

)  (x2)  d/p1)  d/n2) 

P(0) 

P<2, 

2) 

"  (X2 

)2  d/n2)2  p(o)  . 

The  fora  of  the  solution  is: 

P(x1.t2 . *k>  "  [xlkl  Ed/|»i>kl  (l/ji2k2l  P(0) 

where  k2  and  k2  equals  the  number  of  clsss  1  snd  class  2  customers 
respectively. 
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D-AH2  994  NETWORKS  OF  MARKOVIAN  QUEUES <U)  ARMV  ENGINEER  HRTERHRVS 
EXPERIMENT  STATION  VICKSBURG  MS  INSTRUMENTATION 
SERVICES  DIV  R  A  FRANCO  HAV  87  MES/TR/0-Q7-2 

F/G  12/3 


UNCLASSIFIED 


A  queueing  network  that  consist*  of  a  single  service  center  ie 


depicted  in  Fignre  A.2.  There  is  only  one  onetoaer  clase,  bnt  the 


eerwice  tiae  is  represented  by  two  exponential  stages,  and  the  service 


discipline  is  last-coae-first-serve-preeaptiv*  re anas. 


Fignre  A.2  Service  Center  with  Two  Exponential  Stages. 


In  order  that  the  state  saaaarise  all  past  history  of  the  process. 


it  anst  contain  the  stage  that  each  onetoaer  was  in  when  preeapted  and 


his  order  at  the  service  center.  If  the  service  center  contains  k 


enstoaers,  then  let  (a2,a2,...,ak)  be  the  state,  where  a2  is  the  stage 


of  the  last  enstoaer  to  arrive. 


By  Equating  the  rat*  of  flow  into  and  out  of  a  state  the  following 


global  balance  equations,  for  states  in  which  there  are  two  or  fewer 


enstoaers,  are  obtained 


SqXPCO)  -  gjbjPd)  +  ji2P(2) 

(Hj+aoJOPd)  -  a0AP(0)  +  ^bjPd.l)  +  h2P<2,1) 
(p2+a0X)P(2)  -  PjSjPd)  +  jijbjPd.2)  +  p2P<2,2) 
(p1<t>a0X)P(l,l)  -  a0APd)  +  PjbjPd.1.1)  +  n2P(2.1,l) 


/u1*  A.V.N  .'|JV  ,N.S  _>  A  A  A  .*»  *»  A  AA  AA  A  .A  -S  A 


•  j* 

aM 

AA, 


•.  V' 

‘X'tlC 


'•■A*' 


■ 


*V* 

'“V*  V%‘ 


-  .  -  •  -  Aj,  -> 


(l^+agXjPd.k)  -  «0XP(2)  ♦  p^Pd.1,2)  ♦  ^(2.1,2) 

(n2+«0X)Pd.I>--  p^Pd.l)  +  n^Pd.2,1)  +  P2P(2.2.1) 

(|»2+*0X>P(2,2)  -  |i1a1P(l,2)  +  ^^(1,2.2)  ♦  jijPd.2,2)  . 

In  the  first  three  equations  there  ere  seven  unknowns.  In  the 
first  sewen  equations  there  ere  fifteen  unknowns.  Again,  no  aster  how 
aany  equations  are  written  there  will  always  be  aore  unknowns  than 
equations. 

The  corresponding  loeal  balance  equations  are  obtained  by  equating 
the  rate  of  flow  ont  of  a  state  dne  a  oustoaer  leaving  a  stage  of 
service  to  the  rate  of  flow  into  that  state  due  to  oustoaer  entering 
that  stage: 

SgkP(O)  -  PjbjPd)  +  |i2P(2) 

PjPd)  -  SqXP(O) 

agXPd)  -  ^bjPd.l)  ♦  pjPd.l) 

p2P(2)  -  g1s1P(l) 

a0XP(2)  -  ^bjPd,!)  ♦  h2P(2'2> 

HjPd.l)  -  agXPd) 

a0XP(l,l)  -  UjbjPd.1,1)  ♦  h2P(2,1,1) 

PjPd.2)  -  a0XP(2) 

a0XP(l,2)  -  HjbjPd.1,1)  +  h2P(2,1,2) 

!i2P(2,l)  -  p^Pd.l) 

a0XP(2,l)  -  jijb^d.2,1)  +  |t2  P(2,2.1) 


|i2P<2,2)  -  ^.^(1,2) 

»0XP(2»2)  -  H^Pd.2.2)  +  ^(2,2.2) 


Tha  sun  of  tk*  local  balanoa  aquations  ara  tka  global  balanoe 
equations.  Thera fora  the  solution  of  the  looal  balanoe  equations  will 
satisfy  the  global  balanoe  equations.  The  following  is  a  snbset  of  the 
looal  balanoe  equations  : 


HjPd)  -  SqXP(O) 
U2P<2)  -  l^ajPd) 
lijPd.l)  -  a0XPd> 
HjPd.2)  -  a0XP(2> 
|i2P(2.1)  ■  iijSjPd.l) 
|i2P(2,2)  «  (t1a1P(l,2) 


Notice  that  there  are  six  equations  and  seven  unknowns.  Solving  these 
equations  in  terns  of  P(0)  results  in  : 


P(l) 


IqX 


P(0> 


P(2) 


*0*1^ 


"2 


P(0) 


p(i.i) 


Mr 


(H,)‘ 


P(0) 


p(i,2) 


a  2a  3l2 

*0 


P(0) 
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P(2,2)  -  P(0)  . 

(Hj)1 


Tkt  torn  of  thi  solution  for  thin  six  ititu  is 


ihir* 


fi(-i> 


r  v 

1*0* 


fj(*i)  •  •  •  fv(*v) 


qX/iij  for  *t-l 
O^X/iij  for  Bj-2 


0  -  1/P(0)  . 


It  it  U17  to  Torify  that  this  is  tho  aolmtioa  for  any  atata.  It 
aatisfiaa  both  tho  looal  and  global  balanoo  aquations.  Tho  solution 
also  agrooa  with  tho  aquations  in  Chaptor  6. 
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APPENDIX  B 


SOURCE  LISTING  OF  MVA  PROGRAM 


MULTIPLE  CHAIN.  LOAD  INDEPENDENT  NETWORKS 


Program  MVA  (input, output) ; 


Const 

Max_M  =  3; 
MmxjC  *  10 j 
MaxSize  >  1000; 


{Maxinun  number  of  Service  Centers) 
{Maxinun  nunber  of  Chains  or  Classes) 


Type 

Population_Vector  =  Array [1.. Max  C]  of  Integer; 
Matrix  *  Array [  1 . . Max_M .  1 . . Max_c]"  of  Real; 
ServerType  =  0..1;  {0  *  IS  ,  1  ■  all  others) 


Var 

N.NJMax 


Popul at ion_Vec tor ; 


L.T.R.V.S  :  Matrix; 

Length  :  Array [1.. Max JM,0. .MaxSise]  of  Real; 
Queue  :  Array [ 1 . . Max_M]  of  ServerType; 

M  :  integer;  {Number  of  Service  Centers) 

C  :  integer;  {Nunber  of  Chains  or  Classes) 

I.K  :  Integer; 


This  function  increments  the  present  population  vector,  N,  and 
is  set  to  false,  if  N  does  not  equal  the  maximum  population 
vector,  N_Max.  In  addition  to  the  above  parameters  the  length 
of  both  population  vector,  C,  is  passed  to  the  function. 


Function  Increment_Population_Vector 

(Var  N 
NMax 
C 

Var 

Flag  :  Boolean; 

J  :  Integer; 


Populat ion_Vector ; 
Population_Vector; 
Integer) t  Boolean; 


WM 


B«gin 

J  ^  1;  (jlways  start  from  the  far  left  and  proceed  to  the  right) 

Repeat 

N[J]  TS"N[J]  +  li 

Zf  N[J]  <*  N_Max [J]  then  Flag  :=  True 

Else  {reset  present  column  and  increment  nest  column) 

Begin 

Flag  :=  False; 

N{J]  :*  0; 

J  :=  J  +  1 
End; 

Until  ((J  >  C)  Or  Flag); 

Increment_Population_Vector  j=  (j  >  C) 

End; 

{ - 

Given  a  population  vector,  N,  this  function  computes  the  row 
index  value  (0. .HazSize)  of  the  matrix  Length.  The  formula  is  : 
Index  s=  nl  +  [N  Max(l)+1]  n2  +  [N  Max(l)+1] [N  Max(2)+1]  n3  + 

...  +  [N_Max(l)+l] [N_Max(2)+lI... [N_M«c(C-2)+l]  n(C-l) 

where  nl,n2 . nC  are  the  elements  of  the  population  vector  N, 

and  N_Max(l),N_Max(2), . . . ,NJMax(C)  are  the  elements  of  the  maximum 
population  vector, N_Hax.  Note  the  maximum  index  value  is  : 
[N_max(l)+1] [N_Max(2)+lJ... [N  Max(C-l)],  and  is  not 
[Njmax(l)+1] [N_Max(2)+l] . . .  [N~Max(C-l)] [N_Max(C)l . 

Hence  a  considerable  memory  saving  is  accomplished  by  writing  over 
Length  values  that  are  no  longer  required  by  the  MVA  algorithm. 

To  take  maximum  advange  of  this  saving  the  chain  with  the  largest 
population  should  be  nC.  ) 

Function  Index  (N,N_Max  :  Population_Vector;  C: Integer):  Integer; 
Var 

J, Sum, Radix  :  Integer; 

Begin 

If  C  *  1  then  Index  :*  0 

Else 

Begin 

Sum  :*  N[l] ; 

Radix  :*  N  Max(l]  ♦  1; 

For  J  s*  2~To  (C-l)  do 

Begin 

Sum  :*  Sum  ♦  (  N[J]  *  Radix  ); 

Radix  :«  Radix  *  (  N_Max[J]  +  1  ) 

End;  (*  for  *) 

Index  :*  Sum 
End  (*  else  *) 

End;  (*  Index  *) 


For  I  :=  1  to  M  do 

If  Queue [I]  =  0  (*  if  infinite  server  *) 

_  then  R[I.K]  :=  S[I,K] 

Else 

Begin 

N[K]  :=  N[K]  -  1; 

R[I,K]  t»  S[I,K]  *  (  1  +  Length  [I.  Index  (N.NJtax.C)]  ) 
H[K]  s=  N[K]  +  1 
End; 

(*  celulate  throughput  T  *) 

(*  celuelete  L  by  Class  *) 

X  i*  0; 

For  I  :*  1  to  M  do  Xs»  X  +  V[I.R]  *  R[I.K]; 

For  I  :*  1  to  M  do 
Begin 

T[I.K]  :«  N[Kl  *  V[I.K]  /  X; 

Ltl.Kl  :*  T[I,K]  *  R[I,K] 

End 

End  (*  else  *) 

End;  (*  for  *) 

(*  celulate  total  L  of  each  queue  *) 

For  I  :*  1  to  H  do 
Begin 
X  0; 

For  K  i*  1  to  C  do  X  s«  X  +  L[I.K]; 

Length [I, Index (N,N_Ka*.C)J  :=  X 
End; 

Until  Inc rement_Population_7ector (N, N_Max, C) ; 

(*  print  performance  parameters  *) 

Writeln; 

Writeln; 

Writeln  ('Center  Chain  Throughtput  Response  Time  Q-Length  ') 
For  i:=l  to  M  do 
For  K:=l  to  C  do 
begin 

WriteC  '.1:2 ); 

Write ('  ' ,Ks2) ; 

WriteC  ' »T[I«K] :  10) ; 

WriteC  \R[I,K]slO); 

Writeln ('  L[I,k]slO) 
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